Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X....................X.........................] duration: 7.808392115s FAIL (2025-06-25 02:16:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.808434699s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X....................X........................] duration: 8.043242849s FAIL (2025-06-25 02:16:03 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 8.043268549s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X....................X.......................] duration: 7.583945759s FAIL (2025-06-25 02:15:12 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.583993553s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X....................X......................] duration: 13.906501785s FAIL (2025-06-25 02:14:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 13.906527214s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X....................X.....................] duration: 6.643408789s FAIL (2025-06-25 02:13:50 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 6.643436672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X....................X....................] duration: 7.443181412s FAIL (2025-06-25 02:12:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.44323212s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X....................X...................] duration: 8.277886681s FAIL (2025-06-25 02:12:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 8.277918553s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X....................X..................] duration: 10.267020271s FAIL (2025-06-25 02:11:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 10.26704625s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X....................X.................] duration: 7.703307906s FAIL (2025-06-25 02:10:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.703332064s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X....................X................] duration: 13.909967995s FAIL (2025-06-25 02:10:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 13.910001962s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X....................X...............] duration: 9.150744119s FAIL (2025-06-25 02:09:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 9.150809405s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X....................X..............] duration: 13.334617233s FAIL (2025-06-25 02:08:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 13.334641811s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X....................X.............] duration: 11.405139201s FAIL (2025-06-25 02:08:19 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 11.405170873s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X....................X............] duration: 7.318642723s FAIL (2025-06-25 02:07:08 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.318667832s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X....................X...........] duration: 7.417119813s FAIL (2025-06-25 02:06:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 7.417145092s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X....................X..........] duration: 11.402198962s FAIL (2025-06-25 02:06:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 11.402221114s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X....................X.........] duration: 5.733100662s FAIL (2025-06-25 02:05:55 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 5.73312573s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X....................X........] duration: 10.012936383s FAIL (2025-06-25 02:05:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 10.012957564s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration: 12.635126785s FAIL (2025-06-25 02:04:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 12.63515446s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X....................X......] duration: 16.840249401s FAIL (2025-06-25 02:03:10 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 16.840268559s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X....................X.....] duration: 5.698947667s FAIL (2025-06-25 02:01:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 5.698973667s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X....................X....] duration: 11.410211709s FAIL (2025-06-25 02:01:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 11.410241205s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X....................X...] duration: 11.672263257s FAIL (2025-06-25 02:00:32 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 11.672288405s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X....................X..] duration: 10.213149517s FAIL (2025-06-25 01:59:29 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 10.213173223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X....................X.] duration: 8.765760407s FAIL (2025-06-25 01:58:29 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 8.765779134s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X....................X] duration: 30.001816965s FAIL (2025-06-25 01:57:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jun 25 01:56:51.221178176 (40h46m25.991819511s) [upload=32531]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:56:51.515131203 (40h46m26.285772528s) [upload=32531]: Done uploading segments... Jun 25 01:56:51.515147645 (40h46m26.28578898s) [upload=32531]: Upload finished. err: <nil> Jun 25 01:57:19.084236458 (40h46m53.854877823s) [upload=32538]: Starting upload Jun 25 01:57:19.084344367 (40h46m53.854985722s) [upload=32538]: Done starting upload Jun 25 01:57:19.084468798 (40h46m53.855110173s) [upload=32538]: Uploading segments... Jun 25 01:57:19.084697521 (40h46m53.855338876s) [upload=32538]: Got next segment. Inline: false Jun 25 01:57:19.084747819 (40h46m53.855389174s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:57:19.084755283 (40h46m53.855396648s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:57:19.317920137 (40h46m54.088561472s) [seg_pos={0 0}, upload=32538]: Begin upload segment... Jun 25 01:57:19.317968261 (40h46m54.088609596s) [seg_pos={0 0}, upload=32538]: Done begin upload segment. Jun 25 01:57:19.317996586 (40h46m54.088637921s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318047705 (40h46m54.08868903s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318346855 (40h46m54.08898818s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318526723 (40h46m54.089168058s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318602399 (40h46m54.089243734s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318842113 (40h46m54.089483448s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.318925244 (40h46m54.089566589s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319092588 (40h46m54.089733923s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319330209 (40h46m54.089971534s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319576726 (40h46m54.090218071s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319829686 (40h46m54.090471021s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.319884112 (40h46m54.090525447s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320118615 (40h46m54.09075995s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320332750 (40h46m54.090974085s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320593695 (40h46m54.09123502s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:19.320672939 (40h46m54.091314274s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Uploading piece... Jun 25 01:57:21.004186623 (40h46m55.774827958s) [upload=32538]: Next returned nil segment Jun 25 01:57:21.004201271 (40h46m55.774842606s) [upload=32538]: Waiting for error group managing segments... Jun 25 01:57:21.373405862 (40h46m56.144047197s) [noise=true , address=45.91.116.7:4009 , piece_id=HQLHWOX2J3WRLZMMMT4U3G74SEQ6JXEUUW6LPMTRIAYFKSA7VYDQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.380540770 (40h46m56.151182105s) [noise=true , address=45.91.116.6:4973 , piece_id=NB4TVDRSLPU5MJNSP2S46X4Y7GQZCI4ZFGE636VNMZJVFCYPND2Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406216388 (40h46m56.176857723s) [noise=true , address=77.90.31.16:4734 , piece_id=FV3BW4KKGILZ64MDYMVZCWBTXLHGJ42KT6OPRQ3D5PNFHC2MXK4A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.406531558 (40h46m56.177172893s) [noise=true , address=77.90.31.11:4553 , piece_id=LY6ZNU54JOBMSQUHKIVRSIO4DHRDINUYYAJEZDCJG2Y2JN3ZTH2A, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.413930989 (40h46m56.184572324s) [noise=true , address=77.90.31.13:4628 , piece_id=V3NBPYML5LGRAH4VWIDC5MNEXKBTIB22I2ICYLESNAEIZWRS4JSA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.418444851 (40h46m56.189086186s) [noise=true , address=77.90.31.10:4519 , piece_id=BZY2WT4HER4FFFSQFKNPEDUL6DAXOLMCTPC6BBBYGAMGIHAAM4UQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.450429187 (40h46m56.221070512s) [noise=true , address=45.91.116.10:4083 , piece_id=ZXYVYU6RYXS2DUJY5SFRHIAQ5C5A7VFR5WUXHY55PFSZ5C5ION5Q, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.451791586 (40h46m56.222432921s) [noise=true , address=45.91.116.12:5227 , piece_id=WAYLVFZ5JZGAA2DO2TFCQO5HQN5FKTED642GKLXNPXJH5426L2RQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.461695047 (40h46m56.232336372s) [noise=true , address=45.91.116.12:5225 , piece_id=ZYBO4RY72O2ENHQL43DMR7PJWKSVIXOUB4MFGTPVRB7VDYKLVSGQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.465101795 (40h46m56.23574312s) [noise=true , address=45.91.116.13:4154 , piece_id=5CO7RVYGMY66M5NGEQ2W3MG6WFHEGMWSOVP24HYFDANQH6LLGWUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:21.516253534 (40h46m56.286894869s) [noise=true , address=45.91.116.11:4119 , piece_id=LJOG5IILWQCG2QAQ7JBEBYW7T5ZAFKOMEU2735VAUPZMEVUV4CMA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:22.126274879 (40h46m56.896916214s) [noise=true , address=77.90.31.10:4518 , piece_id=KXNW7PNSTLKXHXRFVXSPB63YIOHVDQREL3D3GLYQJDTKOFMTMDUQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256195959 (40h47m4.026837284s) [noise=true , address=104.36.82.15:4257 , piece_id=N5IMTSWIGPENDENU4XGCG4FXZKGUOT2GWA6KCJYVEAKKMVSNC6SQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: <nil> Jun 25 01:57:29.256217671 (40h47m4.026859006s) [seg_pos={0 0}, upload=32538]: Segment reached optimal threshold of 13 pieces. Jun 25 01:57:29.256444921 (40h47m4.027086246s) [noise=true , address=104.36.82.5:4838 , piece_id=UXOJRBK2YWWMLUMBOCWEWDEI4QH56AVCQG3WRIT2UKQ67XRJ6VWQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36982->104.36.82.5:4838: use of closed network connection Jun 25 01:57:29.256487343 (40h47m4.027128678s) [noise=true , address=77.90.31.14:4663 , piece_id=OBYHC3FUIR6W6MVC7CKF25SW5JQZCYPPII2H4MOI3D6J4SG5K6VQ, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54040->77.90.31.14:4663: use of closed network connection Jun 25 01:57:29.256544754 (40h47m4.027186079s) [noise=true , address=104.36.82.14:4221 , piece_id=7RB7VEGUDNT2ZBNJWHEMHF4YEL7PHDAY4XYO47P2DWRJPOJEYIAA, seg_pos={0 0}, upload=32538]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50190->104.36.82.14:4221: use of closed network connection Jun 25 01:57:29.256578479 (40h47m4.027219814s) [seg_pos={0 0}, upload=32538]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:57:29.256660598 (40h47m4.027301923s) [upload=32538]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:57:29.256667341 (40h47m4.027308676s) [upload=32538]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:57:29.697233572 (40h47m4.467874937s) [upload=32538]: Done uploading segments... Jun 25 01:57:29.697257679 (40h47m4.467899055s) [upload=32538]: Upload finished. err: <nil> Duration:* 30.001836984s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 15.417017141s FAIL (2025-06-25 01:57:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 15.4170378s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 8.163131153s FAIL (2025-06-25 01:55:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 8.163157103s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 12.693714744s FAIL (2025-06-25 01:54:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 12.693740865s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 11.522694743s FAIL (2025-06-25 01:54:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 11.522713459s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 21.387565746s FAIL (2025-06-25 01:53:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 21.387591385s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.954853323s FAIL (2025-06-25 01:52:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 6.954896035s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 12.193214945s FAIL (2025-06-25 01:52:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 12.193240395s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 9.737414609s FAIL (2025-06-25 01:51:33 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 9.737436181s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 21.073184973s FAIL (2025-06-25 01:51:12 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 21.073214251s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.782064923s FAIL (2025-06-25 01:49:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 5.782084551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 20.08867284s FAIL (2025-06-25 01:49:24 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 20.088699581s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 7.712526004s FAIL (2025-06-25 01:48:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 7.712548437s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.897189902s FAIL (2025-06-25 01:47:15 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 6.897219429s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 14.673018243s FAIL (2025-06-25 01:46:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 14.673049574s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 20.825681062s FAIL (2025-06-25 01:46:08 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 20.825703857s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 18.734542513s FAIL (2025-06-25 01:45:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 18.734568073s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 10.747494309s FAIL (2025-06-25 01:44:32 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 10.747521913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 23.582456934s FAIL (2025-06-25 01:43:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 23.58248088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 14.160449963s FAIL (2025-06-25 01:42:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 14.160474552s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 9.75831212s FAIL (2025-06-25 01:42:19 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 9.758329253s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002050092s FAIL (2025-06-25 01:42:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== n 25 01:41:20.513401818 (40h30m55.284043143s) [seg_pos={0 0}, upload=32326]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:20.513474540 (40h30m55.284115875s) [upload=32326]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:20.513478858 (40h30m55.284120193s) [upload=32326]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:20.810666510 (40h30m55.581307845s) [upload=32326]: Done uploading segments... Jun 25 01:41:20.810681960 (40h30m55.581323295s) [upload=32326]: Upload finished. err: <nil> Jun 25 01:41:39.684244941 (40h31m14.454886276s) [upload=32333]: Starting upload Jun 25 01:41:39.684302342 (40h31m14.454943667s) [upload=32333]: Done starting upload Jun 25 01:41:39.684398217 (40h31m14.455039552s) [upload=32333]: Uploading segments... Jun 25 01:41:39.684489154 (40h31m14.455130489s) [upload=32333]: Got next segment. Inline: false Jun 25 01:41:39.684531707 (40h31m14.455173042s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 01:41:39.684537067 (40h31m14.455178402s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 01:41:39.923009812 (40h31m14.693651157s) [seg_pos={0 0}, upload=32333]: Begin upload segment... Jun 25 01:41:39.923057294 (40h31m14.693698629s) [seg_pos={0 0}, upload=32333]: Done begin upload segment. Jun 25 01:41:39.923089096 (40h31m14.693730431s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923550809 (40h31m14.694192144s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.923833978 (40h31m14.694475314s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924124130 (40h31m14.694765465s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924415264 (40h31m14.695056599s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924672913 (40h31m14.695314248s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.924940551 (40h31m14.695581886s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925194794 (40h31m14.695836129s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925455388 (40h31m14.696096713s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.925716233 (40h31m14.696357568s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926006356 (40h31m14.696647691s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926271970 (40h31m14.696913305s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926529799 (40h31m14.697171134s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.926781967 (40h31m14.697423302s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927049185 (40h31m14.69769052s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:39.927308147 (40h31m14.697949482s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Uploading piece... Jun 25 01:41:41.701636116 (40h31m16.472277451s) [upload=32333]: Next returned nil segment Jun 25 01:41:41.701649863 (40h31m16.472291198s) [upload=32333]: Waiting for error group managing segments... Jun 25 01:41:41.982896641 (40h31m16.753537976s) [noise=true , address=45.91.116.8:4045 , piece_id=C5IOOHHSF77ZDB62E3PH7IVDJW2OKH5QLBV5RV3QVOSVST7CYYQA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.001740267 (40h31m16.772381612s) [noise=true , address=45.91.116.11:4118 , piece_id=JGQY6DUMSXG2NII2UKLVIJB5MYMMULM2S2MN6VQJQMZTHMJ3DISA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.002843112 (40h31m16.773484447s) [noise=true , address=45.91.116.6:4974 , piece_id=KT3DXGRJ52LULWUG5AC3G4R5DYRVZ3IO33WJFHLAAB64G2Z3XRSQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.049503533 (40h31m16.820144868s) [noise=true , address=77.90.31.13:4628 , piece_id=SEQ2Z5FOSAYXT2Q6M24G4R7J3TECRGHBOONMT4DISHSN2YQNYUOQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.067767315 (40h31m16.83840865s) [noise=true , address=45.91.116.12:5225 , piece_id=XF3STAAWZCGMBRB4HQBDRYWZYNCWOMDQPQZITYODISUAR6G22WCA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.075291889 (40h31m16.845933224s) [noise=true , address=45.91.116.6:4973 , piece_id=L5IJRU5DKJ3FXMBTZS2LGSJQSJU7LBQRJYXIOAR42ODNSIPBZVPQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.081117361 (40h31m16.851758696s) [noise=true , address=45.91.116.12:5226 , piece_id=XI6CHH7JTGOGEZH7EE3C4BMIBVKDJGQKHFBCFK2KLI2QW22D42CA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.088648357 (40h31m16.859289692s) [noise=true , address=77.90.31.12:4590 , piece_id=AXWNRBKQ3Z7TZNUEZXBH77MGC4SM5TGEACBRK4CHZPXX7FSWI4VA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.101203322 (40h31m16.871844658s) [noise=true , address=45.91.116.5:5298 , piece_id=KL4GHH6EXGJTLAFBAVPHPUJ5MF7HJX3YQ7EP6EGEVXUFKMALRBCQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.381306566 (40h31m17.151947901s) [noise=true , address=77.90.31.13:4626 , piece_id=CO5JYRRFBUH72W6INQT3BA54CJ53HBBM3EBPFMOE4OLGNHSE7JSA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:42.412835490 (40h31m17.183476825s) [noise=true , address=77.90.31.12:4589 , piece_id=QFGOOMWUONFAFTHBEBTEDSOBDVJ36IM3ZUMEUFOGANLVS3SWTVZA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:43.039812754 (40h31m17.810454089s) [noise=true , address=77.90.31.11:4555 , piece_id=MDOY3M5BKZCGGCXIE5JZ2A423DQPVBSEDAHNKRNQLJOTP6AYRWFQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931869001 (40h31m27.702510327s) [noise=true , address=104.36.82.15:4257 , piece_id=YAMYCJAHKWIH3ML47P6MUYUN7Y6N2HFXLD3SQI2BD5QBBNLLDDYA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: <nil> Jun 25 01:41:52.931893148 (40h31m27.702534483s) [seg_pos={0 0}, upload=32333]: Segment reached optimal threshold of 13 pieces. Jun 25 01:41:52.932069229 (40h31m27.702710564s) [noise=true , address=104.36.82.7:4910 , piece_id=62QR2SJLAKCLIB4YM266D66YQBLV2ZOSDE6OVL7H4SHYCPYWLM6A, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Jun 25 01:41:52.932154273 (40h31m27.702795609s) [noise=true , address=77.90.31.14:4662 , piece_id=DGB5SDQSXTZREQWXIRAX5FA73ONZUEQQ4Q7WTRV3CCRS5NUJI2TQ, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59324->77.90.31.14:4662: use of closed network connection Jun 25 01:41:52.932162119 (40h31m27.702803454s) [noise=true , address=104.36.82.13:4185 , piece_id=XTPHRSOWTOB2DNVBKBOHIGQOY4R6I2HCNUTIVX4QCFSCOZWLO7OA, seg_pos={0 0}, upload=32333]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN): protocol: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46696->104.36.82.13:4185: use of closed network connection Jun 25 01:41:52.932198990 (40h31m27.702840325s) [seg_pos={0 0}, upload=32333]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 25 01:41:52.932277062 (40h31m27.702918387s) [upload=32333]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 25 01:41:52.932281650 (40h31m27.702922985s) [upload=32333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 25 01:41:53.240370765 (40h31m28.0110121s) [upload=32333]: Done uploading segments... Jun 25 01:41:53.240387327 (40h31m28.011028662s) [upload=32333]: Upload finished. err: <nil> Duration: 30.002069299s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 21.438428637s FAIL (2025-06-24 15:39:04 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 21.438448646s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.823570756s FAIL (2025-06-24 15:38:11 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 5.823605343s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.679217236s FAIL (2025-06-24 15:37:30 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 5.679245s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)