Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.07500083s FAIL (2025-09-08 12:53:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.075022962s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001866146s FAIL (2025-09-08 12:53:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 1m0.001891734s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.679120631s FAIL (2025-09-08 12:52:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.679145829s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.................X..............X.....X.............X..X..XX] duration: 30.297686823s FAIL (2025-09-08 12:52:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 38]: Starting upload Sep 8 12:52:26.707403638 (47h24m2.746976759s) [upload=41638]: Done starting upload Sep 8 12:52:26.707501887 (47h24m2.747075007s) [upload=41638]: Uploading segments... Sep 8 12:52:26.707792252 (47h24m2.747365372s) [upload=41638]: Got next segment. Inline: false Sep 8 12:52:26.707818302 (47h24m2.747391422s) [upload=41638]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:26.707823752 (47h24m2.747396862s) [upload=41638]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:27.371946292 (47h24m3.411519412s) [seg_pos={0 0}, upload=41638]: Begin upload segment... Sep 8 12:52:27.371994745 (47h24m3.411567865s) [seg_pos={0 0}, upload=41638]: Done begin upload segment. Sep 8 12:52:27.372001478 (47h24m3.411574598s) [noise=true , address=77.90.31.19:4843 , piece_id=QXK3HLDJFF3LWGE4ZBPXZMXQED22WZD2B44EZLTPZWOWXCC7SDWA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.372010185 (47h24m3.411583295s) [noise=true , address=145.79.227.14:4838 , piece_id=DLBYRVZVIM5EUJ66JCGQSFMKR5HTSBIPPJO3BGIV5TVJ4OAMEV6Q, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.372360324 (47h24m3.411933444s) [noise=true , address=45.91.116.6:4974 , piece_id=CIBXZMJCF2226LRGU7DRBCDHZ7K54CJVQZGIULTUCNFBKUC624DQ, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.372623929 (47h24m3.412197049s) [noise=true , address=77.90.31.13:4627 , piece_id=TZMMZVDEE6SUQQGGQICGJ4BGIUIS5DCIG52FMDVKPU5X6PNLOQAA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.372926788 (47h24m3.412499898s) [noise=true , address=77.90.31.12:4592 , piece_id=BD4BOAOXC5MF3ZCCNHPGCO4HDO6JSY6ZHEK2GXLGPUIE5VBNY76Q, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.373002083 (47h24m3.412575193s) [noise=true , address=145.79.227.13:4804 , piece_id=OL2KSHEEZAII4Q4DUVQBQ5KGXDULH2Z325OGWWTC6EQ2W3BSI7EA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.373280786 (47h24m3.412853906s) [noise=true , address=45.91.116.9:4261 , piece_id=KH25DCJL2W4FTKIJYVC4XO4CWOGC7GFP7TR3HGUYDJQJ4ISOHF6Q, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.373595519 (47h24m3.413168639s) [noise=true , address=77.90.31.21:4878 , piece_id=DUG2D6NMUYUDRFLT67UHQCUX25A5GUJ3GJ43FECFHKVGRGCM6VYA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.373723072 (47h24m3.413296182s) [noise=true , address=45.91.116.5:4299 , piece_id=ZC6QE2OP2MSNHNPYFDJ36KOK6DRYHFS6UBM6IHLQEKWUUXMHWR2Q, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.373987969 (47h24m3.413561089s) [noise=true , address=77.90.31.21:4879 , piece_id=TMDDTHQNBRYISGA6J3FUGODNGFZK4QGR5D4LZ6PMCHB2UUODLMWQ, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.374205395 (47h24m3.413778515s) [noise=true , address=45.91.116.7:4009 , piece_id=2FUKIFF5QGIC7NDDXAWQA4WLIHRYI67MD6CUFDBDK5YEVWOUDWIA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.374300256 (47h24m3.413873376s) [noise=true , address=145.79.227.4:4187 , piece_id=GA7O6PHIQJLIDXP4M6KT6JHUT77IY2KRJZJBZDNX2WYNLOGYKJSA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.374589941 (47h24m3.414163061s) [noise=true , address=45.91.116.14:4189 , piece_id=5KLGFYN7XL2SDGOYYWEF5MX5BJ6SEQ7Z7PGCV6ZO2PE5PIAT7SMA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.374824570 (47h24m3.41439769s) [noise=true , address=45.91.116.8:4048 , piece_id=ZO2WNYJ2HD5SXU2PFLLM6BHY7XSDA4PY2A6NVV24QNLTLYBB7GLA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.375029161 (47h24m3.414602271s) [noise=true , address=45.91.116.10:4082 , piece_id=YWL252YHQMS4JRPVEGSB7BIATQTWJSISJYMMNVI42GEWPKNYVC5Q, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:27.375326831 (47h24m3.414899951s) [noise=true , address=45.91.116.4:4938 , piece_id=M75LVVPY6Q3JR4DBFJT5JF2ZENM3JX4G5SGM5RZI75YYCEOBCDSA, seg_pos={0 0}, upload=41638]: Uploading piece... Sep 8 12:52:43.639883196 (47h24m19.679456306s) [upload=41638]: Next returned nil segment Sep 8 12:52:43.639901932 (47h24m19.679475053s) [upload=41638]: Waiting for error group managing segments... Sep 8 12:52:44.043316391 (47h24m20.082889511s) [noise=true , address=145.79.227.13:4804 , piece_id=OL2KSHEEZAII4Q4DUVQBQ5KGXDULH2Z325OGWWTC6EQ2W3BSI7EA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:45.008731443 (47h24m21.048304603s) [noise=true , address=45.91.116.9:4261 , piece_id=KH25DCJL2W4FTKIJYVC4XO4CWOGC7GFP7TR3HGUYDJQJ4ISOHF6Q, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:45.275566818 (47h24m21.315139938s) [noise=true , address=77.90.31.13:4627 , piece_id=TZMMZVDEE6SUQQGGQICGJ4BGIUIS5DCIG52FMDVKPU5X6PNLOQAA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:45.808682949 (47h24m21.848256069s) [noise=true , address=77.90.31.12:4592 , piece_id=BD4BOAOXC5MF3ZCCNHPGCO4HDO6JSY6ZHEK2GXLGPUIE5VBNY76Q, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:47.193477208 (47h24m23.233050329s) [noise=true , address=45.91.116.6:4974 , piece_id=CIBXZMJCF2226LRGU7DRBCDHZ7K54CJVQZGIULTUCNFBKUC624DQ, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:49.938242687 (47h24m25.977815807s) [noise=true , address=45.91.116.5:4299 , piece_id=ZC6QE2OP2MSNHNPYFDJ36KOK6DRYHFS6UBM6IHLQEKWUUXMHWR2Q, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:50.304376056 (47h24m26.343949166s) [noise=true , address=145.79.227.14:4838 , piece_id=DLBYRVZVIM5EUJ66JCGQSFMKR5HTSBIPPJO3BGIV5TVJ4OAMEV6Q, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:51.009240568 (47h24m27.048813688s) [noise=true , address=77.90.31.21:4879 , piece_id=TMDDTHQNBRYISGA6J3FUGODNGFZK4QGR5D4LZ6PMCHB2UUODLMWQ, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:51.044225795 (47h24m27.083798905s) [noise=true , address=77.90.31.19:4843 , piece_id=QXK3HLDJFF3LWGE4ZBPXZMXQED22WZD2B44EZLTPZWOWXCC7SDWA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:51.834777776 (47h24m27.874350896s) [noise=true , address=77.90.31.21:4878 , piece_id=DUG2D6NMUYUDRFLT67UHQCUX25A5GUJ3GJ43FECFHKVGRGCM6VYA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: <nil> Sep 8 12:52:52.257171933 (47h24m28.296745053s) [noise=true , address=45.91.116.8:4048 , piece_id=ZO2WNYJ2HD5SXU2PFLLM6BHY7XSDA4PY2A6NVV24QNLTLYBB7GLA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: expected piece hash; context deadline exceeded; EOF Sep 8 12:52:52.257228632 (47h24m28.296801752s) [noise=true , address=45.91.116.14:4189 , piece_id=5KLGFYN7XL2SDGOYYWEF5MX5BJ6SEQ7Z7PGCV6ZO2PE5PIAT7SMA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 188.166.225.170:38218->45.91.116.14:4189: use of closed network connection; write tcp 188.166.225.170:38218->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38218->45.91.116.14:4189: use of closed network connection Sep 8 12:52:52.257312222 (47h24m28.296885342s) [noise=true , address=145.79.227.4:4187 , piece_id=GA7O6PHIQJLIDXP4M6KT6JHUT77IY2KRJZJBZDNX2WYNLOGYKJSA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: write tcp 188.166.225.170:34878->145.79.227.4:4187: use of closed network connection; write tcp 188.166.225.170:34878->145.79.227.4:4187: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->145.79.227.4:4187: use of closed network connection Sep 8 12:52:52.257381183 (47h24m28.296954303s) [noise=true , address=45.91.116.4:4938 , piece_id=M75LVVPY6Q3JR4DBFJT5JF2ZENM3JX4G5SGM5RZI75YYCEOBCDSA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 188.166.225.170:36048->45.91.116.4:4938: use of closed network connection; write tcp 188.166.225.170:36048->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36048->45.91.116.4:4938: use of closed network connection Sep 8 12:52:52.257415960 (47h24m28.29698908s) [noise=true , address=45.91.116.10:4082 , piece_id=YWL252YHQMS4JRPVEGSB7BIATQTWJSISJYMMNVI42GEWPKNYVC5Q, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: expected piece hash; context deadline exceeded; EOF Sep 8 12:52:52.257429145 (47h24m28.297002265s) [noise=true , address=45.91.116.7:4009 , piece_id=2FUKIFF5QGIC7NDDXAWQA4WLIHRYI67MD6CUFDBDK5YEVWOUDWIA, seg_pos={0 0}, upload=41638]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 188.166.225.170:60580->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:60580->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60580->45.91.116.7:4009: use of closed network connection Sep 8 12:52:52.257448202 (47h24m28.297021322s) [seg_pos={0 0}, upload=41638]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 8 12:52:52.552630761 (47h24m28.592203881s) [upload=41638]: Done uploading segments... Sep 8 12:52:52.552657091 (47h24m28.592230211s) [upload=41638]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.297712883s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.195291426s FAIL (2025-09-08 12:52:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.195311805s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.349556632s FAIL (2025-09-08 12:52:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.349577985s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 23.39784133s FAIL (2025-09-08 12:52:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 23.397857882s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000795664s FAIL (2025-09-08 12:52:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000831272s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 12.402884309s FAIL (2025-09-08 12:52:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 12.402903334s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001367949s FAIL (2025-09-08 12:52:24 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001381515s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001107203s FAIL (2025-09-08 12:52:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.00113168s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001743811s FAIL (2025-09-08 12:52:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 30.001773628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [..................X..............X.....X.............X..X..X] duration: 30.001722479s FAIL (2025-09-08 12:51:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:51:27.495146369 (47h23m3.53471949s) [upload=41628]: Starting upload Sep 8 12:51:27.495212966 (47h23m3.534786087s) [upload=41628]: Done starting upload Sep 8 12:51:27.495280245 (47h23m3.534853365s) [upload=41628]: Uploading segments... Sep 8 12:51:27.495406046 (47h23m3.534979156s) [upload=41628]: Got next segment. Inline: false Sep 8 12:51:27.495436965 (47h23m3.535010085s) [upload=41628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:51:27.495440862 (47h23m3.535013982s) [upload=41628]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:51:27.748952883 (47h23m3.788526003s) [seg_pos={0 0}, upload=41628]: Begin upload segment... Sep 8 12:51:27.749001816 (47h23m3.788574936s) [seg_pos={0 0}, upload=41628]: Done begin upload segment. Sep 8 12:51:27.749026413 (47h23m3.788599523s) [noise=true , address=77.90.31.16:4733 , piece_id=CESM577CNP63LFOBXPYHB7FNKUFLNT57JHB2YW4JER6CX3MUCIPA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.749074846 (47h23m3.788647956s) [noise=true , address=77.90.31.10:4518 , piece_id=ZM64CD4HL55OUDGQM3UUZLLQHXC6OH7IA7K75FBOPM3WXLC7APWA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.749497114 (47h23m3.789070234s) [noise=true , address=77.90.31.17:4771 , piece_id=A5IYLP3ADM265TPIE7TR3CH5GMYJHEEJB7C44WY2G6I36TCONFCQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.749525539 (47h23m3.789098679s) [noise=true , address=45.91.116.8:4048 , piece_id=HKYKKR4JON2T4F5VTABK6JGT4GTJFPVFWDOZ5BIMK34LE2FWLREQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.749849137 (47h23m3.789422247s) [noise=true , address=45.91.116.9:4262 , piece_id=XG6UEKEPUUENDKZ5ATNNG4YCKZ7A6HN6YQHJZSHINYYSNSVAW4UA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.750004775 (47h23m3.789577895s) [noise=true , address=145.79.227.11:4729 , piece_id=CH4VAV7CHKN7MH5XD4GA6VJMRXFZM7YSWDR32FXW6BJBRKCM373Q, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.750307614 (47h23m3.789880765s) [noise=true , address=77.90.31.14:4661 , piece_id=2LAEK3SGP575NBMAVYED7OD64SJBKR64MH2XZLNI3PJ4VJIXRYMQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.750733490 (47h23m3.79030663s) [noise=true , address=77.90.31.13:4628 , piece_id=TQMISUHQZRZ33NS4ALI3TVJH2I5FBBF4IVAUTQSHTQL54IMNIREA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.750769549 (47h23m3.790342669s) [noise=true , address=45.91.116.11:4118 , piece_id=L7CQYCYAUL5AIQZ4QRKR27Z3WTFNCFHRV7OSHJWUXH3HTGDSIVJQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.750819224 (47h23m3.790392344s) [noise=true , address=45.91.116.5:4299 , piece_id=4NUR35ZB6NJFSSQYC27J6WCBEFIY7SXLNJHBWLUGIEL7MNSJFZKA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.751102135 (47h23m3.790675255s) [noise=true , address=45.91.116.4:4937 , piece_id=3VC7E7SI7AE2N6HEB3UEODJP2UJNW5VICDMZENQADHZ5FQ4PLI7Q, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.751320813 (47h23m3.790893933s) [noise=true , address=77.90.31.19:4841 , piece_id=J7P33PLDXZEMXNG5TROHS4VWQRUBLSNFC2ILHNUEI2F3VAXS3QXQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.751367122 (47h23m3.790940252s) [noise=true , address=145.79.227.16:4912 , piece_id=UG6IXOZ4Q5DW5P3NETLVK6ECFCMKDZOJ4DCHAQHZEBGD3GSWCOIA, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.751536596 (47h23m3.791109716s) [noise=true , address=145.79.227.13:4801 , piece_id=6AIRD6TRNKWM2F2OM272LIYWYWFROFQKVI5D7VCL7NDHRK6G2E2Q, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.751760716 (47h23m3.791333836s) [noise=true , address=45.91.116.10:4081 , piece_id=NLKKOWWDTM6GCLB5GN3Q6BRRS6PUTTNM2C4TJDVUGH6J2LBYOKEQ, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:27.752004833 (47h23m3.791577953s) [noise=true , address=145.79.227.5:4221 , piece_id=ZNZ2AWGA43DVSKHLZ6TMBUCTBHVTASXE35JHD37TBBTV5YRGT77A, seg_pos={0 0}, upload=41628]: Uploading piece... Sep 8 12:51:29.780177987 (47h23m5.819751107s) [upload=41628]: Next returned nil segment Sep 8 12:51:29.780199819 (47h23m5.819772939s) [upload=41628]: Waiting for error group managing segments... Sep 8 12:51:30.115728233 (47h23m6.155301343s) [noise=true , address=145.79.227.16:4912 , piece_id=UG6IXOZ4Q5DW5P3NETLVK6ECFCMKDZOJ4DCHAQHZEBGD3GSWCOIA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.150182794 (47h23m6.189755914s) [noise=true , address=77.90.31.16:4733 , piece_id=CESM577CNP63LFOBXPYHB7FNKUFLNT57JHB2YW4JER6CX3MUCIPA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.261963504 (47h23m6.301536624s) [noise=true , address=45.91.116.10:4081 , piece_id=NLKKOWWDTM6GCLB5GN3Q6BRRS6PUTTNM2C4TJDVUGH6J2LBYOKEQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.276019772 (47h23m6.315592882s) [noise=true , address=45.91.116.11:4118 , piece_id=L7CQYCYAUL5AIQZ4QRKR27Z3WTFNCFHRV7OSHJWUXH3HTGDSIVJQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.310908573 (47h23m6.350481693s) [noise=true , address=77.90.31.13:4628 , piece_id=TQMISUHQZRZ33NS4ALI3TVJH2I5FBBF4IVAUTQSHTQL54IMNIREA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.352122167 (47h23m6.391695287s) [noise=true , address=77.90.31.19:4841 , piece_id=J7P33PLDXZEMXNG5TROHS4VWQRUBLSNFC2ILHNUEI2F3VAXS3QXQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.363744648 (47h23m6.403317768s) [noise=true , address=77.90.31.17:4771 , piece_id=A5IYLP3ADM265TPIE7TR3CH5GMYJHEEJB7C44WY2G6I36TCONFCQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.378375695 (47h23m6.417948866s) [noise=true , address=145.79.227.13:4801 , piece_id=6AIRD6TRNKWM2F2OM272LIYWYWFROFQKVI5D7VCL7NDHRK6G2E2Q, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.383217701 (47h23m6.422790821s) [noise=true , address=145.79.227.11:4729 , piece_id=CH4VAV7CHKN7MH5XD4GA6VJMRXFZM7YSWDR32FXW6BJBRKCM373Q, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.423412827 (47h23m6.462985947s) [noise=true , address=45.91.116.4:4937 , piece_id=3VC7E7SI7AE2N6HEB3UEODJP2UJNW5VICDMZENQADHZ5FQ4PLI7Q, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.424903089 (47h23m6.464476209s) [noise=true , address=45.91.116.9:4262 , piece_id=XG6UEKEPUUENDKZ5ATNNG4YCKZ7A6HN6YQHJZSHINYYSNSVAW4UA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.436211639 (47h23m6.475784759s) [noise=true , address=77.90.31.14:4661 , piece_id=2LAEK3SGP575NBMAVYED7OD64SJBKR64MH2XZLNI3PJ4VJIXRYMQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.443971107 (47h23m6.483544227s) [noise=true , address=45.91.116.5:4299 , piece_id=4NUR35ZB6NJFSSQYC27J6WCBEFIY7SXLNJHBWLUGIEL7MNSJFZKA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: <nil> Sep 8 12:51:30.443991887 (47h23m6.483565007s) [seg_pos={0 0}, upload=41628]: Segment reached optimal threshold of 13 pieces. Sep 8 12:51:30.444180237 (47h23m6.483753357s) [noise=true , address=145.79.227.5:4221 , piece_id=ZNZ2AWGA43DVSKHLZ6TMBUCTBHVTASXE35JHD37TBBTV5YRGT77A, seg_pos={0 0}, upload=41628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF Sep 8 12:51:30.444262324 (47h23m6.483835444s) [noise=true , address=45.91.116.8:4048 , piece_id=HKYKKR4JON2T4F5VTABK6JGT4GTJFPVFWDOZ5BIMK34LE2FWLREQ, seg_pos={0 0}, upload=41628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:44532->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:44532->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44532->45.91.116.8:4048: use of closed network connection Sep 8 12:51:30.444273876 (47h23m6.483846986s) [noise=true , address=77.90.31.10:4518 , piece_id=ZM64CD4HL55OUDGQM3UUZLLQHXC6OH7IA7K75FBOPM3WXLC7APWA, seg_pos={0 0}, upload=41628]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: write tcp 188.166.225.170:45272->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:45272->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45272->77.90.31.10:4518: use of closed network connection Sep 8 12:51:30.444309725 (47h23m6.483882845s) [seg_pos={0 0}, upload=41628]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:51:30.444382153 (47h23m6.483955273s) [upload=41628]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:51:30.444386371 (47h23m6.483959491s) [upload=41628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:51:30.783943405 (47h23m6.823516515s) [upload=41628]: Done uploading segments... Sep 8 12:51:30.783961790 (47h23m6.82353491s) [upload=41628]: Upload finished. err: <nil> Duration: 30.001744791s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 10.291175891s FAIL (2025-09-08 12:51:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.291205376s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................X..............X.....X.............X..X..] duration: 12.850790859s FAIL (2025-09-08 12:50:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:49:21.339833009 (47h20m57.379406129s) [upload=41598]: Starting upload Sep 8 12:49:21.339889517 (47h20m57.379462637s) [upload=41598]: Done starting upload Sep 8 12:49:21.340017272 (47h20m57.379590442s) [upload=41598]: Uploading segments... Sep 8 12:49:21.340089329 (47h20m57.379662449s) [upload=41598]: Got next segment. Inline: false Sep 8 12:49:21.340153973 (47h20m57.379727113s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:49:21.340164754 (47h20m57.379737924s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:49:22.454086202 (47h20m58.493659322s) [seg_pos={0 0}, upload=41598]: Begin upload segment... Sep 8 12:49:22.454133823 (47h20m58.493706933s) [seg_pos={0 0}, upload=41598]: Done begin upload segment. Sep 8 12:49:22.454155414 (47h20m58.493728534s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454218606 (47h20m58.493791746s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454551072 (47h20m58.494124192s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454744932 (47h20m58.494318042s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454822892 (47h20m58.494396012s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455066989 (47h20m58.494640109s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455090554 (47h20m58.494663674s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455340582 (47h20m58.494913702s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455375469 (47h20m58.494948589s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455679921 (47h20m58.495253041s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455687205 (47h20m58.495260325s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455956861 (47h20m58.495529981s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455987009 (47h20m58.495560129s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456221708 (47h20m58.495794828s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456522123 (47h20m58.496095233s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.459982645 (47h20m58.499555765s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:24.304600275 (47h21m0.344173385s) [upload=41598]: Next returned nil segment Sep 8 12:49:24.304640371 (47h21m0.344213491s) [upload=41598]: Waiting for error group managing segments... Sep 8 12:49:24.597016591 (47h21m0.636589711s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.623042713 (47h21m0.662615833s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.638525832 (47h21m0.678098952s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.671675536 (47h21m0.711248656s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.672520322 (47h21m0.712093442s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688538544 (47h21m0.728111665s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688909053 (47h21m0.728482173s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.719591386 (47h21m0.759164506s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.727644977 (47h21m0.767218097s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.745518369 (47h21m0.785091479s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.770875341 (47h21m0.810448461s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.840870421 (47h21m0.880443541s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956234417 (47h21m0.995807537s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956268773 (47h21m0.995841903s) [seg_pos={0 0}, upload=41598]: Segment reached optimal threshold of 13 pieces. Sep 8 12:49:24.956390706 (47h21m0.995963827s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956480598 (47h21m0.996053718s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956700178 (47h21m0.996273308s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection Sep 8 12:49:24.956714826 (47h21m0.996287956s) [seg_pos={0 0}, upload=41598]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:49:24.956806512 (47h21m0.996379632s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:49:24.956811211 (47h21m0.996384331s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:49:25.297525910 (47h21m1.33709904s) [upload=41598]: Done uploading segments... Sep 8 12:49:25.297548302 (47h21m1.337121422s) [upload=41598]: Upload finished. err: <nil> Duration: 12.850826747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................X..............X.....X.............X..X.] duration: 8.787841503s FAIL (2025-09-08 12:49:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:49:21.339833009 (47h20m57.379406129s) [upload=41598]: Starting upload Sep 8 12:49:21.339889517 (47h20m57.379462637s) [upload=41598]: Done starting upload Sep 8 12:49:21.340017272 (47h20m57.379590442s) [upload=41598]: Uploading segments... Sep 8 12:49:21.340089329 (47h20m57.379662449s) [upload=41598]: Got next segment. Inline: false Sep 8 12:49:21.340153973 (47h20m57.379727113s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:49:21.340164754 (47h20m57.379737924s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:49:22.454086202 (47h20m58.493659322s) [seg_pos={0 0}, upload=41598]: Begin upload segment... Sep 8 12:49:22.454133823 (47h20m58.493706933s) [seg_pos={0 0}, upload=41598]: Done begin upload segment. Sep 8 12:49:22.454155414 (47h20m58.493728534s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454218606 (47h20m58.493791746s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454551072 (47h20m58.494124192s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454744932 (47h20m58.494318042s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454822892 (47h20m58.494396012s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455066989 (47h20m58.494640109s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455090554 (47h20m58.494663674s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455340582 (47h20m58.494913702s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455375469 (47h20m58.494948589s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455679921 (47h20m58.495253041s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455687205 (47h20m58.495260325s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455956861 (47h20m58.495529981s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455987009 (47h20m58.495560129s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456221708 (47h20m58.495794828s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456522123 (47h20m58.496095233s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.459982645 (47h20m58.499555765s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:24.304600275 (47h21m0.344173385s) [upload=41598]: Next returned nil segment Sep 8 12:49:24.304640371 (47h21m0.344213491s) [upload=41598]: Waiting for error group managing segments... Sep 8 12:49:24.597016591 (47h21m0.636589711s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.623042713 (47h21m0.662615833s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.638525832 (47h21m0.678098952s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.671675536 (47h21m0.711248656s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.672520322 (47h21m0.712093442s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688538544 (47h21m0.728111665s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688909053 (47h21m0.728482173s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.719591386 (47h21m0.759164506s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.727644977 (47h21m0.767218097s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.745518369 (47h21m0.785091479s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.770875341 (47h21m0.810448461s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.840870421 (47h21m0.880443541s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956234417 (47h21m0.995807537s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956268773 (47h21m0.995841903s) [seg_pos={0 0}, upload=41598]: Segment reached optimal threshold of 13 pieces. Sep 8 12:49:24.956390706 (47h21m0.995963827s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956480598 (47h21m0.996053718s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956700178 (47h21m0.996273308s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection Sep 8 12:49:24.956714826 (47h21m0.996287956s) [seg_pos={0 0}, upload=41598]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:49:24.956806512 (47h21m0.996379632s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:49:24.956811211 (47h21m0.996384331s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:49:25.297525910 (47h21m1.33709904s) [upload=41598]: Done uploading segments... Sep 8 12:49:25.297548302 (47h21m1.337121422s) [upload=41598]: Upload finished. err: <nil> Duration: 8.787857343s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....................X..............X.....X.............X..X] duration: 30.00245759s FAIL (2025-09-08 12:49:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:49:21.339833009 (47h20m57.379406129s) [upload=41598]: Starting upload Sep 8 12:49:21.339889517 (47h20m57.379462637s) [upload=41598]: Done starting upload Sep 8 12:49:21.340017272 (47h20m57.379590442s) [upload=41598]: Uploading segments... Sep 8 12:49:21.340089329 (47h20m57.379662449s) [upload=41598]: Got next segment. Inline: false Sep 8 12:49:21.340153973 (47h20m57.379727113s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:49:21.340164754 (47h20m57.379737924s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:49:22.454086202 (47h20m58.493659322s) [seg_pos={0 0}, upload=41598]: Begin upload segment... Sep 8 12:49:22.454133823 (47h20m58.493706933s) [seg_pos={0 0}, upload=41598]: Done begin upload segment. Sep 8 12:49:22.454155414 (47h20m58.493728534s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454218606 (47h20m58.493791746s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454551072 (47h20m58.494124192s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454744932 (47h20m58.494318042s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.454822892 (47h20m58.494396012s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455066989 (47h20m58.494640109s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455090554 (47h20m58.494663674s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455340582 (47h20m58.494913702s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455375469 (47h20m58.494948589s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455679921 (47h20m58.495253041s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455687205 (47h20m58.495260325s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455956861 (47h20m58.495529981s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.455987009 (47h20m58.495560129s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456221708 (47h20m58.495794828s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.456522123 (47h20m58.496095233s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:22.459982645 (47h20m58.499555765s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Uploading piece... Sep 8 12:49:24.304600275 (47h21m0.344173385s) [upload=41598]: Next returned nil segment Sep 8 12:49:24.304640371 (47h21m0.344213491s) [upload=41598]: Waiting for error group managing segments... Sep 8 12:49:24.597016591 (47h21m0.636589711s) [noise=true , address=77.90.31.18:4807 , piece_id=67Z7AH522LPJUNZGBMKH63YG2VEPIYTRF5XFVCO57VYNFYGOPYHA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.623042713 (47h21m0.662615833s) [noise=true , address=77.90.31.10:4518 , piece_id=6JBOCNBFN7AFTG3HKAIS3BFCBQNK34JZS4BJEYVHUOE2S6ROFDEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.638525832 (47h21m0.678098952s) [noise=true , address=45.91.116.6:4974 , piece_id=QQRUXV7NDEBZGZJJTPM5C4CJM4T42PP5RTWWCXC32AZ5B6IA5IUQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.671675536 (47h21m0.711248656s) [noise=true , address=45.91.116.8:4047 , piece_id=FFCXGK7EDFT7RSQWLCW7CQTDS2BJLPQCXCENGAV4QTIHSEX54TTQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.672520322 (47h21m0.712093442s) [noise=true , address=145.79.227.5:4222 , piece_id=CPKSAFMEHGBHMESCROPDWFTM6D7AVJ2M7XX524ZP3O7LI2KKTPSA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688538544 (47h21m0.728111665s) [noise=true , address=45.91.116.12:4226 , piece_id=3JDWD6UOM3HHACSUYHUZQCM2OXXCO5FNWRAEVVI5F5NGAHO573VA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.688909053 (47h21m0.728482173s) [noise=true , address=45.91.116.8:4048 , piece_id=MQHWJQ2NGK63BDW224GQXSZAJMOEIMZTGE2VHXS6EORTBHX5OIEQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.719591386 (47h21m0.759164506s) [noise=true , address=77.90.31.21:4879 , piece_id=C52ZNOCZME3AXXPGTMASV7EWTOY2LZ4NX3XYM6XM37J52G4UBR3Q, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.727644977 (47h21m0.767218097s) [noise=true , address=77.90.31.18:4806 , piece_id=LVVNB4Q3SYIRGADZELEKARAM6Q4TW2EKADWOLBVWLAS3BTWW35AQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.745518369 (47h21m0.785091479s) [noise=true , address=77.90.31.15:4697 , piece_id=BEPJ6UEFZVKNBMGNIQWNVQEWK7IRFA2ULKY6ZRSTY3N6AKETIVIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.770875341 (47h21m0.810448461s) [noise=true , address=45.91.116.10:4081 , piece_id=PNIBBFS44D6LTUJAR56QNO66TCPT4RMHJWEQGP4HBF7VITGI2QGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.840870421 (47h21m0.880443541s) [noise=true , address=77.90.31.17:4770 , piece_id=SP6BDJKTG3YYMDNBZQIRTQOPFTI4CXRWZAKVADB64BCNE46VLTSQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956234417 (47h21m0.995807537s) [noise=true , address=145.79.227.17:4971 , piece_id=FP3OGMLKMRJ4BJIEG7V32ND6M3TTP6ZENJVL4CQVA3BMACDYC2XQ, seg_pos={0 0}, upload=41598]: Done uploading piece. err: <nil> Sep 8 12:49:24.956268773 (47h21m0.995841903s) [seg_pos={0 0}, upload=41598]: Segment reached optimal threshold of 13 pieces. Sep 8 12:49:24.956390706 (47h21m0.995963827s) [noise=true , address=145.79.227.13:4804 , piece_id=LKNCJUZLWGDQJH7NIWBQYZJHWWFGTWJK3QAXFV5EEUWZUUA3HAIA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956480598 (47h21m0.996053718s) [noise=true , address=145.79.227.3:4150 , piece_id=HZ5T2QF5L2BIP4YFBJCSF35AHPY46GJS3PEIYDRGXVPU4EK5YD2A, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Sep 8 12:49:24.956700178 (47h21m0.996273308s) [noise=true , address=77.90.31.18:4805 , piece_id=5YULPSZ5C7FI6VTZCQMMAIEKZGDKLYL2GYSQAQSWRAEROQWDQLGA, seg_pos={0 0}, upload=41598]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34166->77.90.31.18:4805: use of closed network connection Sep 8 12:49:24.956714826 (47h21m0.996287956s) [seg_pos={0 0}, upload=41598]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:49:24.956806512 (47h21m0.996379632s) [upload=41598]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:49:24.956811211 (47h21m0.996384331s) [upload=41598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:49:25.297525910 (47h21m1.33709904s) [upload=41598]: Done uploading segments... Sep 8 12:49:25.297548302 (47h21m1.337121422s) [upload=41598]: Upload finished. err: <nil> Duration: 30.002480103s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X..............X.....X.............X..] duration: 17.91890711s FAIL (2025-09-08 12:48:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:47:00.315328962 (47h18m36.354902082s) [upload=41562]: Starting upload Sep 8 12:47:00.315374860 (47h18m36.35494798s) [upload=41562]: Done starting upload Sep 8 12:47:00.315523975 (47h18m36.355097095s) [upload=41562]: Uploading segments... Sep 8 12:47:00.315551628 (47h18m36.355124748s) [upload=41562]: Got next segment. Inline: false Sep 8 12:47:00.315573319 (47h18m36.35514644s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:47:00.315578609 (47h18m36.355151729s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:47:00.600761976 (47h18m36.640335086s) [seg_pos={0 0}, upload=41562]: Begin upload segment... Sep 8 12:47:00.600797694 (47h18m36.640370814s) [seg_pos={0 0}, upload=41562]: Done begin upload segment. Sep 8 12:47:00.600818644 (47h18m36.640391764s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.600824635 (47h18m36.640397756s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601183532 (47h18m36.640756642s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601542289 (47h18m36.641115409s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601730058 (47h18m36.641303178s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601846822 (47h18m36.641419942s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602101329 (47h18m36.641674449s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602331660 (47h18m36.64190478s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602619911 (47h18m36.642193031s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602834081 (47h18m36.642407201s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602888565 (47h18m36.642461685s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603125820 (47h18m36.64269895s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603409492 (47h18m36.642982612s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603636226 (47h18m36.643209346s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603784300 (47h18m36.64335742s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603991726 (47h18m36.643564846s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:02.450104868 (47h18m38.489677988s) [upload=41562]: Next returned nil segment Sep 8 12:47:02.450126189 (47h18m38.489699309s) [upload=41562]: Waiting for error group managing segments... Sep 8 12:47:02.767374173 (47h18m38.806947293s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.799504876 (47h18m38.839077996s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.804093017 (47h18m38.843666137s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.814946766 (47h18m38.854519886s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.816912587 (47h18m38.856485707s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.837166935 (47h18m38.876740055s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.874952390 (47h18m38.91452551s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.879259001 (47h18m38.918832141s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.884225274 (47h18m38.923798404s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.906046230 (47h18m38.94561935s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.940478127 (47h18m38.980051247s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.942336584 (47h18m38.981909704s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.954976941 (47h18m38.994550062s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.955007590 (47h18m38.99458071s) [seg_pos={0 0}, upload=41562]: Segment reached optimal threshold of 13 pieces. Sep 8 12:47:02.955125757 (47h18m38.994698877s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955260875 (47h18m38.994833995s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955312424 (47h18m38.994885544s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955335988 (47h18m38.994909108s) [seg_pos={0 0}, upload=41562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:47:02.955416082 (47h18m38.994989212s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:47:02.955422244 (47h18m38.994995384s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:47:03.278631685 (47h18m39.318204805s) [upload=41562]: Done uploading segments... Sep 8 12:47:03.278650882 (47h18m39.318224012s) [upload=41562]: Upload finished. err: <nil> Duration: 17.918935834s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..............X.....X.............X.] duration: 22.566953007s FAIL (2025-09-08 12:48:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:47:00.315328962 (47h18m36.354902082s) [upload=41562]: Starting upload Sep 8 12:47:00.315374860 (47h18m36.35494798s) [upload=41562]: Done starting upload Sep 8 12:47:00.315523975 (47h18m36.355097095s) [upload=41562]: Uploading segments... Sep 8 12:47:00.315551628 (47h18m36.355124748s) [upload=41562]: Got next segment. Inline: false Sep 8 12:47:00.315573319 (47h18m36.35514644s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:47:00.315578609 (47h18m36.355151729s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:47:00.600761976 (47h18m36.640335086s) [seg_pos={0 0}, upload=41562]: Begin upload segment... Sep 8 12:47:00.600797694 (47h18m36.640370814s) [seg_pos={0 0}, upload=41562]: Done begin upload segment. Sep 8 12:47:00.600818644 (47h18m36.640391764s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.600824635 (47h18m36.640397756s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601183532 (47h18m36.640756642s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601542289 (47h18m36.641115409s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601730058 (47h18m36.641303178s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601846822 (47h18m36.641419942s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602101329 (47h18m36.641674449s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602331660 (47h18m36.64190478s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602619911 (47h18m36.642193031s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602834081 (47h18m36.642407201s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602888565 (47h18m36.642461685s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603125820 (47h18m36.64269895s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603409492 (47h18m36.642982612s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603636226 (47h18m36.643209346s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603784300 (47h18m36.64335742s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603991726 (47h18m36.643564846s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:02.450104868 (47h18m38.489677988s) [upload=41562]: Next returned nil segment Sep 8 12:47:02.450126189 (47h18m38.489699309s) [upload=41562]: Waiting for error group managing segments... Sep 8 12:47:02.767374173 (47h18m38.806947293s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.799504876 (47h18m38.839077996s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.804093017 (47h18m38.843666137s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.814946766 (47h18m38.854519886s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.816912587 (47h18m38.856485707s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.837166935 (47h18m38.876740055s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.874952390 (47h18m38.91452551s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.879259001 (47h18m38.918832141s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.884225274 (47h18m38.923798404s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.906046230 (47h18m38.94561935s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.940478127 (47h18m38.980051247s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.942336584 (47h18m38.981909704s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.954976941 (47h18m38.994550062s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.955007590 (47h18m38.99458071s) [seg_pos={0 0}, upload=41562]: Segment reached optimal threshold of 13 pieces. Sep 8 12:47:02.955125757 (47h18m38.994698877s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955260875 (47h18m38.994833995s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955312424 (47h18m38.994885544s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955335988 (47h18m38.994909108s) [seg_pos={0 0}, upload=41562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:47:02.955416082 (47h18m38.994989212s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:47:02.955422244 (47h18m38.994995384s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:47:03.278631685 (47h18m39.318204805s) [upload=41562]: Done uploading segments... Sep 8 12:47:03.278650882 (47h18m39.318224012s) [upload=41562]: Upload finished. err: <nil> Duration: 22.566971022s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X..............X.....X.............X] duration: 30.001957388s FAIL (2025-09-08 12:47:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:47:00.315328962 (47h18m36.354902082s) [upload=41562]: Starting upload Sep 8 12:47:00.315374860 (47h18m36.35494798s) [upload=41562]: Done starting upload Sep 8 12:47:00.315523975 (47h18m36.355097095s) [upload=41562]: Uploading segments... Sep 8 12:47:00.315551628 (47h18m36.355124748s) [upload=41562]: Got next segment. Inline: false Sep 8 12:47:00.315573319 (47h18m36.35514644s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:47:00.315578609 (47h18m36.355151729s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:47:00.600761976 (47h18m36.640335086s) [seg_pos={0 0}, upload=41562]: Begin upload segment... Sep 8 12:47:00.600797694 (47h18m36.640370814s) [seg_pos={0 0}, upload=41562]: Done begin upload segment. Sep 8 12:47:00.600818644 (47h18m36.640391764s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.600824635 (47h18m36.640397756s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601183532 (47h18m36.640756642s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601542289 (47h18m36.641115409s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601730058 (47h18m36.641303178s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.601846822 (47h18m36.641419942s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602101329 (47h18m36.641674449s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602331660 (47h18m36.64190478s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602619911 (47h18m36.642193031s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602834081 (47h18m36.642407201s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.602888565 (47h18m36.642461685s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603125820 (47h18m36.64269895s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603409492 (47h18m36.642982612s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603636226 (47h18m36.643209346s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603784300 (47h18m36.64335742s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:00.603991726 (47h18m36.643564846s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Uploading piece... Sep 8 12:47:02.450104868 (47h18m38.489677988s) [upload=41562]: Next returned nil segment Sep 8 12:47:02.450126189 (47h18m38.489699309s) [upload=41562]: Waiting for error group managing segments... Sep 8 12:47:02.767374173 (47h18m38.806947293s) [noise=true , address=145.79.227.14:4837 , piece_id=RN3VHNT5ESQGMMZASBZCFEX4AHF5QLLV3CEZNHT3ZLY5JVK72VZA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.799504876 (47h18m38.839077996s) [noise=true , address=145.79.227.11:4731 , piece_id=7FZTZTH4EXK4O4PYUTMNOQB5OECRKPTWSU3BFOM4JNWJ7BLT3UOQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.804093017 (47h18m38.843666137s) [noise=true , address=45.91.116.14:4190 , piece_id=UPYRTMFPX6GBBYPHNP73MRYLMRMOEPNCVSSYUQHGMZYRTILQY2JA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.814946766 (47h18m38.854519886s) [noise=true , address=45.91.116.5:4297 , piece_id=VAH37FKT6FRUYFLFXC4C6CELTAEDBGNUFU5YNEDKY2AKJBGLR3DQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.816912587 (47h18m38.856485707s) [noise=true , address=145.79.227.6:4258 , piece_id=V4AARJ75DDHY2OGKFASPINGU74I7YMXM5JERPVJXS6UK2PPQ6LJQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.837166935 (47h18m38.876740055s) [noise=true , address=45.91.116.7:4010 , piece_id=Q37T2AL4B2DY3MGKXDTAOIMKL2VUEF4E5Y5W25GCP7DAQ4WMT3KA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.874952390 (47h18m38.91452551s) [noise=true , address=77.90.31.17:4771 , piece_id=LFATSDRJREWUOZQF72CYKV546J3PLYPGKGCZRIA7E3S5A5MAFUBQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.879259001 (47h18m38.918832141s) [noise=true , address=45.91.116.13:4154 , piece_id=RCFCWCBIGKP4PRSQDOWL36YAVCN7VQZVTRDNPYXTNGBTJ6IO6GHA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.884225274 (47h18m38.923798404s) [noise=true , address=77.90.31.13:4627 , piece_id=MQTAVHZI37I5SZRLNWLG7RFMHGF242JNOYKPK7772TRXYN5DOPOA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.906046230 (47h18m38.94561935s) [noise=true , address=77.90.31.12:4590 , piece_id=X3MQ3YUIGD75D6UKH6H5P3RKLEJFPOFLVPDENBFVWAWSWLRBXEWQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.940478127 (47h18m38.980051247s) [noise=true , address=145.79.227.14:4838 , piece_id=TMGMJ4NDDYX4HBRAQRJJDTENIDP2EPP6VN6KUP3WBKUNMGF4FFMA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.942336584 (47h18m38.981909704s) [noise=true , address=77.90.31.18:4807 , piece_id=CDDZ7JOXLY3H54ZX5RQKVBZW4DGDAVNIVYYHLZ7OE4ISFKLMLOIQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.954976941 (47h18m38.994550062s) [noise=true , address=145.79.227.13:4803 , piece_id=XCLYO22MI72RAN2TNQKELSIGCXAIHDWU5H6NHIXGN2QYIYIRX36Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: <nil> Sep 8 12:47:02.955007590 (47h18m38.99458071s) [seg_pos={0 0}, upload=41562]: Segment reached optimal threshold of 13 pieces. Sep 8 12:47:02.955125757 (47h18m38.994698877s) [noise=true , address=77.90.31.15:4697 , piece_id=BP6T2BJWWJDOO4RY4Q33RQPTVLZ4JZWY4QVQGAQCYDVIDKX4AU5Q, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955260875 (47h18m38.994833995s) [noise=true , address=45.91.116.8:4048 , piece_id=JBUP6QIBQM2B57V6KOYNUUTWEHJ4QMITY63VDMA3CSFBVBG47FQA, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955312424 (47h18m38.994885544s) [noise=true , address=145.79.227.5:4222 , piece_id=LORACR7WAU2RXQ4VZQFHB7UODRK4QHS4ALI2YPVYVFXIMYPQ3DVQ, seg_pos={0 0}, upload=41562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1): protocol: expected piece hash; context canceled; EOF Sep 8 12:47:02.955335988 (47h18m38.994909108s) [seg_pos={0 0}, upload=41562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:47:02.955416082 (47h18m38.994989212s) [upload=41562]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:47:02.955422244 (47h18m38.994995384s) [upload=41562]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:47:03.278631685 (47h18m39.318204805s) [upload=41562]: Done uploading segments... Sep 8 12:47:03.278650882 (47h18m39.318224012s) [upload=41562]: Upload finished. err: <nil> Duration: 30.001980884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..............X.....X.............] duration: 18.960110318s FAIL (2025-09-08 12:46:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 18.96013769s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..............X.....X............] duration: 15.650867764s FAIL (2025-09-08 12:46:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 15.65089205s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..............X.....X...........] duration: 7.404366803s FAIL (2025-09-08 12:45:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 7.404405899s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X..............X.....X..........] duration: 6.629399469s FAIL (2025-09-08 12:44:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 6.629425749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..............X.....X.........] duration: 20.612763834s FAIL (2025-09-08 12:43:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 20.612790634s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..............X.....X........] duration: 11.744527563s FAIL (2025-09-08 12:43:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 11.74455775s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..............X.....X.......] duration: 14.030889976s FAIL (2025-09-08 12:42:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 14.030915504s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X..............X.....X......] duration: 9.259694014s FAIL (2025-09-08 12:42:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 9.259721057s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..............X.....X.....] duration: 22.410729731s FAIL (2025-09-08 12:41:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 22.410759947s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..............X.....X....] duration: 9.424536978s FAIL (2025-09-08 12:41:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 9.424571545s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..............X.....X...] duration: 13.301403797s FAIL (2025-09-08 12:40:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 13.301433113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X..............X.....X..] duration: 16.446914726s FAIL (2025-09-08 12:40:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 16.446944422s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X..............X.....X.] duration: 12.287870304s FAIL (2025-09-08 12:40:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 12.28788965s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..............X.....X] duration: 30.002037811s FAIL (2025-09-08 12:39:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:39:19.106830565 (47h10m55.146403686s) [upload=41450]: Starting upload Sep 8 12:39:19.106891021 (47h10m55.146464141s) [upload=41450]: Done starting upload Sep 8 12:39:19.107000110 (47h10m55.14657323s) [upload=41450]: Uploading segments... Sep 8 12:39:19.107143324 (47h10m55.146716444s) [upload=41450]: Got next segment. Inline: false Sep 8 12:39:19.107176196 (47h10m55.146749316s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:39:19.107181187 (47h10m55.146754297s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:39:19.637947971 (47h10m55.677521091s) [seg_pos={0 0}, upload=41450]: Begin upload segment... Sep 8 12:39:19.637982377 (47h10m55.677555497s) [seg_pos={0 0}, upload=41450]: Done begin upload segment. Sep 8 12:39:19.638001423 (47h10m55.677574543s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638013085 (47h10m55.677586205s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638343548 (47h10m55.677916668s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638350140 (47h10m55.67792326s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638682908 (47h10m55.678256018s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638694419 (47h10m55.678267529s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638955830 (47h10m55.67852895s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.638974956 (47h10m55.678548076s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639221057 (47h10m55.678794177s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639244291 (47h10m55.678817411s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639490643 (47h10m55.679063763s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639709531 (47h10m55.679282651s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.639926427 (47h10m55.679499547s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640151557 (47h10m55.679724667s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.640630033 (47h10m55.680203153s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:19.641557117 (47h10m55.681130247s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Uploading piece... Sep 8 12:39:21.438726923 (47h10m57.478300043s) [upload=41450]: Next returned nil segment Sep 8 12:39:21.438746891 (47h10m57.478320011s) [upload=41450]: Waiting for error group managing segments... Sep 8 12:39:21.808218959 (47h10m57.847792079s) [noise=true , address=45.91.116.8:4045 , piece_id=FBYAQ4XI3BWPRLVB3RVBLUIAZWVSO75EQ7JDJIPDAHKKMM2A3Q6A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.809095676 (47h10m57.848668796s) [noise=true , address=145.79.227.7:4294 , piece_id=55D4YIFSJKYUJCIGS5NMEVRG5AZU34XL2IHUCQWO2IRBUWHHDFQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.811300535 (47h10m57.850873655s) [noise=true , address=77.90.31.21:4879 , piece_id=PFOV5DVF5FG5ALQSIUJM5TAEKXJMC5KPOM2XYBEYWMYK3CDMNN7A, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.815436830 (47h10m57.85500995s) [noise=true , address=45.91.116.11:4119 , piece_id=JH5LOVZ4EOGSQDOKSHFCZOCBB7BCOODFBJNJLTHD2AAPTI4T2AKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.826511923 (47h10m57.866085043s) [noise=true , address=45.91.116.14:4191 , piece_id=A7C73KJM4SV6MD24ETDG5T4IKQPCKGNHYE4R6VM5HNFNMQ3ML6JQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.831806224 (47h10m57.871379344s) [noise=true , address=45.91.116.4:4940 , piece_id=V4NABOIGKOKANTRZXCF35UUNKRZSWMW3OYM7D7XOIZAW5Y645IQA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.839843724 (47h10m57.879416844s) [noise=true , address=77.90.31.14:4661 , piece_id=YSAUNSJL23GI2OOHYHVY7QN2WGMHHNH2THKEPX7AJTCZP2NTQ6LA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.846990310 (47h10m57.88656345s) [noise=true , address=145.79.227.19:4079 , piece_id=J7EBS5Q6FCYTXTFLP5YQ3DJFZSY3CEF3RSLQAQPNEUKNKSGO3PDQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.865334713 (47h10m57.904907833s) [noise=true , address=45.91.116.6:4975 , piece_id=LWMIZT35LXRERTZZMUZ6H54P6N5PIRKRUHW6NAY5BB2D5X4QKVXA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.866789517 (47h10m57.906362647s) [noise=true , address=77.90.31.15:4698 , piece_id=PJKMSSSP5SUXYPZTSIII6BEQKOICI5BXLMNLHRXFXCE6UELMJOKQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.868237968 (47h10m57.907811088s) [noise=true , address=45.91.116.5:4298 , piece_id=6LYUC7TF2XLR5DQXJQNINCJWRUYDJQDRHHQGQAJJI3KAI37UE4RA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.917142951 (47h10m57.956716071s) [noise=true , address=145.79.227.5:4221 , piece_id=PRZMME67BLBCFZQ37NAWEXB6VPJD5QKZZ3ZSJSCGTVJ6YSIJI4RQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937704516 (47h10m57.977277626s) [noise=true , address=45.91.116.9:4263 , piece_id=C3GVU3PAK6COX7D3TY245QJZCHAXUMN7D77PHS5JLY6USSIXKUEQ, seg_pos={0 0}, upload=41450]: Done uploading piece. err: <nil> Sep 8 12:39:21.937730005 (47h10m57.977303115s) [seg_pos={0 0}, upload=41450]: Segment reached optimal threshold of 13 pieces. Sep 8 12:39:21.937947221 (47h10m57.977520341s) [noise=true , address=145.79.227.11:4729 , piece_id=HEGRLWYBZKUMF6VC3E6SEWQWEOGRPXW3RIFLQ2DI3UQCV5KIKBRA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56024->145.79.227.11:4729: use of closed network connection Sep 8 12:39:21.937958793 (47h10m57.977543946s) [noise=true , address=145.79.227.18:4006 , piece_id=MUQSTBLNZ7NXYDRKNW26LXPQH73VDML6FHFWUUOPXBYKS4SKNYSA, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc): protocol: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50156->145.79.227.18:4006: use of closed network connection Sep 8 12:39:21.937980956 (47h10m57.977554076s) [noise=true , address=145.79.227.11:4730 , piece_id=M62BAWQ7HGSDE435EH63KDIN27BJSIRZJT2FRPQHAILGQ552B52Q, seg_pos={0 0}, upload=41450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58146->145.79.227.11:4730: use of closed network connection Sep 8 12:39:21.937996505 (47h10m57.977569625s) [seg_pos={0 0}, upload=41450]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:39:21.938084493 (47h10m57.977657613s) [upload=41450]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:39:21.938088722 (47h10m57.977661832s) [upload=41450]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:39:22.233424255 (47h10m58.272997415s) [upload=41450]: Done uploading segments... Sep 8 12:39:22.233449583 (47h10m58.273022753s) [upload=41450]: Upload finished. err: <nil> Duration: 30.002055145s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..............X.....] duration: 8.04946126s FAIL (2025-09-08 12:38:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 8.04948691s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..............X....] duration: 12.673764933s FAIL (2025-09-08 12:38:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 12.67380578s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..............X...] duration: 9.255211803s FAIL (2025-09-08 12:37:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 9.25524652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..............X..] duration: 28.879324745s FAIL (2025-09-08 12:36:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 28.879348772s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..............X.] duration: 7.707949129s FAIL (2025-09-08 12:35:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 7.707988504s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..............X] duration: 30.001642521s FAIL (2025-09-08 12:34:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:34:16.659023818 (47h5m52.698596938s) [upload=41383]: Starting upload Sep 8 12:34:16.659108530 (47h5m52.69868165s) [upload=41383]: Done starting upload Sep 8 12:34:16.659202651 (47h5m52.698775771s) [upload=41383]: Uploading segments... Sep 8 12:34:16.659374910 (47h5m52.69894803s) [upload=41383]: Got next segment. Inline: false Sep 8 12:34:16.659712898 (47h5m52.699286018s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:34:16.659719691 (47h5m52.699292811s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:34:16.947175826 (47h5m52.986748946s) [seg_pos={0 0}, upload=41383]: Begin upload segment... Sep 8 12:34:16.947224528 (47h5m52.986797648s) [seg_pos={0 0}, upload=41383]: Done begin upload segment. Sep 8 12:34:16.947258604 (47h5m52.986831724s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947279163 (47h5m52.986852333s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947695240 (47h5m52.98726836s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.947949426 (47h5m52.987522576s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948010512 (47h5m52.987583632s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948321077 (47h5m52.987894197s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948552450 (47h5m52.98812557s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.948962224 (47h5m52.988535344s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949427945 (47h5m52.989001075s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.949924805 (47h5m52.989497936s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.950729836 (47h5m52.990302956s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951066741 (47h5m52.990639861s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951395370 (47h5m52.9909685s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.951748766 (47h5m52.991321886s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952076303 (47h5m52.991649423s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:16.952379903 (47h5m52.991953034s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Uploading piece... Sep 8 12:34:18.826289074 (47h5m54.865862194s) [upload=41383]: Next returned nil segment Sep 8 12:34:18.826310375 (47h5m54.865883495s) [upload=41383]: Waiting for error group managing segments... Sep 8 12:34:19.118982321 (47h5m55.158555441s) [noise=true , address=45.91.116.11:4119 , piece_id=F4NAJOQTAXMKCWLHECK2W5XXDQNJO4F3MD5O3EZQI4N27LTYYDNQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.131033272 (47h5m55.170606392s) [noise=true , address=145.79.227.13:4803 , piece_id=3KSZOI2LF26NHM6SQOSUI6NC5HKPKKFEXLUQQPHFYVU3Q6LANHIA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.132515949 (47h5m55.172089069s) [noise=true , address=145.79.227.11:4730 , piece_id=CA6SQUIDLOFSAYIQNZRXZCYS2MFTT7VHOL3FWHLZ4EBHGOSGFXFQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.153232842 (47h5m55.192805962s) [noise=true , address=77.90.31.14:4662 , piece_id=NZQHBPASTZUJQQYMHWK4RNM3AJ5D6JBQNMEQGWRWYSI5H5IMQOMA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.192208144 (47h5m55.231781264s) [noise=true , address=45.91.116.9:4263 , piece_id=XYTGHE36TXH4JJ3AHHVO7WI54LRSCAUZGPUAVITU6FDTELKDGLDQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194470323 (47h5m55.234043443s) [noise=true , address=77.90.31.17:4771 , piece_id=J3QOPPGBQR47226GXJ4EP6IECVMVQSRYBPVUUCIFQDE7IDJQX6UQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.194621572 (47h5m55.234194682s) [noise=true , address=77.90.31.19:4843 , piece_id=26QGXDD3X5SP4IY5LNT4KPZVO62ESXXCNVHPWYNVQHN7GBUDTZCQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.223893445 (47h5m55.263466555s) [noise=true , address=145.79.227.18:4006 , piece_id=6P3LTYJ3NB3BFAMH5UVHB5EBWYQW75U4AF5DIZERJLNPXTFYXP6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.231569534 (47h5m55.271142654s) [noise=true , address=145.79.227.15:4876 , piece_id=7GUQIKMA5XBQSQUXDBCVCMJFEPBKCOOWRAMCZXG5362ZMS7D4FBA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.276107861 (47h5m55.315680981s) [noise=true , address=45.91.116.14:4191 , piece_id=3H7A5OJMY2WLFR7QQ454CSZDYB7KHQ63SFV6QSAY7S6OMFQGBVTA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.311871617 (47h5m55.351444737s) [noise=true , address=145.79.227.5:4221 , piece_id=ZND2CSMBAAVWFS6PAFVBIJAP6LA3TQI6WJFWVVF5LOCIGLYDEMOQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.393073702 (47h5m55.432646822s) [noise=true , address=145.79.227.5:4223 , piece_id=G55PK7WRMJO2RDY74ATVUAFAWFTMEKOHTPT3OJRJU7HPHJFG2J5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483604688 (47h5m55.523177808s) [noise=true , address=45.91.116.5:4298 , piece_id=UWCEOVVAKLIPVFTXLEAXRA65OXUL3U2UXZYE2QYI3LMNNHGYDFWA, seg_pos={0 0}, upload=41383]: Done uploading piece. err: <nil> Sep 8 12:34:19.483639025 (47h5m55.523212165s) [seg_pos={0 0}, upload=41383]: Segment reached optimal threshold of 13 pieces. Sep 8 12:34:19.483807808 (47h5m55.523380928s) [noise=true , address=145.79.227.16:4909 , piece_id=SCBLHGSUOQRUYWZ22QIPMYT6DI4BA2KHW622YCQMSCOCUAFJRW5A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x): protocol: expected piece hash; context canceled; EOF Sep 8 12:34:19.483910825 (47h5m55.523483945s) [noise=true , address=77.90.31.18:4805 , piece_id=JUAAQLILGDQS3ZHE2MEXJSC5KI5QA5RIRWVALL7AWPB276JQHSPQ, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35736->77.90.31.18:4805: use of closed network connection Sep 8 12:34:19.483963035 (47h5m55.523536155s) [noise=true , address=77.90.31.19:4841 , piece_id=CLGEPFUIZIOPQY7SCGJXV4NCGDALSTQTIN4SWDJAY6EHMV55SO6A, seg_pos={0 0}, upload=41383]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49774->77.90.31.19:4841: use of closed network connection Sep 8 12:34:19.483983483 (47h5m55.523556603s) [seg_pos={0 0}, upload=41383]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:34:19.484053468 (47h5m55.523626588s) [upload=41383]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:34:19.484059669 (47h5m55.523632809s) [upload=41383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:34:19.844797964 (47h5m55.884371084s) [upload=41383]: Done uploading segments... Sep 8 12:34:19.844831960 (47h5m55.88440508s) [upload=41383]: Upload finished. err: <nil> Duration: 30.001657439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 11.741300993s FAIL (2025-09-08 12:33:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 11.741322514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 18.499124896s FAIL (2025-09-08 12:33:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 18.499163889s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 8.865150712s FAIL (2025-09-08 12:32:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 8.865178646s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 18.145265327s FAIL (2025-09-08 12:31:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 18.145292108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 10.025206204s FAIL (2025-09-08 12:30:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 10.025237985s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.873835363s FAIL (2025-09-08 12:30:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 6.873868115s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 10.832261123s FAIL (2025-09-08 12:30:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 10.83229095s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 16.234782446s FAIL (2025-09-08 12:29:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 16.234809128s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 10.09976838s FAIL (2025-09-08 12:28:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 10.099790883s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 8.048987347s FAIL (2025-09-08 12:27:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:24:46.760588031 (46h56m22.800161151s) [upload=41244]: Starting upload Sep 8 12:24:46.760645090 (46h56m22.80021821s) [upload=41244]: Done starting upload Sep 8 12:24:46.760732057 (46h56m22.800305177s) [upload=41244]: Uploading segments... Sep 8 12:24:46.760832980 (46h56m22.8004061s) [upload=41244]: Got next segment. Inline: false Sep 8 12:24:46.760869039 (46h56m22.80044216s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:24:46.760873478 (46h56m22.800446598s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:24:47.023301800 (46h56m23.06287491s) [seg_pos={0 0}, upload=41244]: Begin upload segment... Sep 8 12:24:47.023341366 (46h56m23.062914486s) [seg_pos={0 0}, upload=41244]: Done begin upload segment. Sep 8 12:24:47.023365732 (46h56m23.062938852s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023373858 (46h56m23.062946978s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023713207 (46h56m23.063286327s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023794893 (46h56m23.063368013s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.023971201 (46h56m23.063544321s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024071452 (46h56m23.063644572s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024195290 (46h56m23.0637684s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024334977 (46h56m23.063908087s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024473131 (46h56m23.064046271s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024619721 (46h56m23.064192901s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.024799516 (46h56m23.064372636s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025076956 (46h56m23.064650087s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025125990 (46h56m23.064699111s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025286979 (46h56m23.064860089s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025343427 (46h56m23.064916547s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:47.025538971 (46h56m23.065112091s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Uploading piece... Sep 8 12:24:48.846573156 (46h56m24.886146276s) [upload=41244]: Next returned nil segment Sep 8 12:24:48.846591161 (46h56m24.886164281s) [upload=41244]: Waiting for error group managing segments... Sep 8 12:24:49.140835915 (46h56m25.180409035s) [noise=true , address=45.91.116.13:4153 , piece_id=WNH7SLF4E4FV5OP7W6H5EJ2EAOIS2IALRZQQ67PASMTSFB2O4WYA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.164615839 (46h56m25.204188959s) [noise=true , address=45.91.116.14:4190 , piece_id=RYNK4XCTHJQMPS4RGUEYNO6N3TYHEGSVWJFNFN52OVM4HEWVX5KQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.172441363 (46h56m25.212014483s) [noise=true , address=77.90.31.14:4662 , piece_id=T2X5MMHN3YT5KO7WT6DTNJOSAOZKL2TCVQ3JFOWP63EDX6KHZDZQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.190437891 (46h56m25.230011011s) [noise=true , address=77.90.31.15:4699 , piece_id=ZOTM7KNUSCCMO4BDRSYV5C5MZK6BS7KLNLSGZ5RCYNB43LBI4OJQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.203458407 (46h56m25.243031527s) [noise=true , address=45.91.116.7:4009 , piece_id=A3YS6U3RSVZZVV535C3CIMRLISJPQDFN45ZETO7AGQNYOJVOEYZA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.205330699 (46h56m25.244903819s) [noise=true , address=45.91.116.4:4940 , piece_id=NE54DNCQ737WNZQDYYK4AGUTMWO6DEJEETYUO6FVW5DNSN2OXK2Q, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.214416525 (46h56m25.253989635s) [noise=true , address=77.90.31.12:4589 , piece_id=T7N5GAE6D2ITEGJLE2DV4PRIDWB3QB773NMEJFDC7XZRSRK7VH7A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219126668 (46h56m25.258699788s) [noise=true , address=45.91.116.5:4298 , piece_id=IHLW3E6PHY7VXRBW7VVB4OUBP7BFEKZXXPCTZ26PART4ZRCYLKFA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.219264672 (46h56m25.258837792s) [noise=true , address=45.91.116.13:4155 , piece_id=COXFPZSBZKCHBVPCKX6VCPMHBL4ZWOQNJELIHPQ5FTS6BXSSUJPQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.231012673 (46h56m25.270585793s) [noise=true , address=145.79.227.7:4295 , piece_id=6ZFTD45BRLONJIN3BD2XQRNRCWUK33MMEDMYX7LZE4SPRB4KO7TA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.321704067 (46h56m25.361277187s) [noise=true , address=45.91.116.11:4119 , piece_id=QP2KQ7J5I3X7B6KMEM47RH3ANEPBETKJ74WOVACZIBIHH54F2BXQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.327170797 (46h56m25.366743917s) [noise=true , address=77.90.31.18:4805 , piece_id=VEQUHRG3T7CN423ML2LIVUKJO3W5ZH6W4YUOF2FTMPELJGSPJS6A, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337541883 (46h56m25.377115003s) [noise=true , address=145.79.227.17:4969 , piece_id=ZCVIDBHQI2OAQC5LD4TQCXIKNILYZMRBYNX6IHOR3G6P3443E3PA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: <nil> Sep 8 12:24:49.337563264 (46h56m25.377136384s) [seg_pos={0 0}, upload=41244]: Segment reached optimal threshold of 13 pieces. Sep 8 12:24:49.337684195 (46h56m25.377257315s) [noise=true , address=45.91.116.7:4010 , piece_id=AWJYJ6PERRZBGD5UQGUURBFPP2M62JDMEQDZYW6AIPJ5OITQIBGQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337746785 (46h56m25.377319905s) [noise=true , address=145.79.227.5:4223 , piece_id=T3NZF6I7O5IKLSOIKXARVJGRZJ24HP4SVIP2HHHKWOTXCP6HFGJA, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE): protocol: expected piece hash; context canceled; EOF Sep 8 12:24:49.337868648 (46h56m25.377441769s) [noise=true , address=45.91.116.12:4225 , piece_id=E43TUAD72ZVNHTQLFYHKFYYUVGLLDR2V53HVRWUC3TTXY6JE46QQ, seg_pos={0 0}, upload=41244]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy): protocol: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39344->45.91.116.12:4225: use of closed network connection Sep 8 12:24:49.337884368 (46h56m25.377457488s) [seg_pos={0 0}, upload=41244]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:24:49.337944292 (46h56m25.377517413s) [upload=41244]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:24:49.337948181 (46h56m25.377521301s) [upload=41244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:24:49.638380796 (46h56m25.677953916s) [upload=41244]: Done uploading segments... Sep 8 12:24:49.638399351 (46h56m25.677972471s) [upload=41244]: Upload finished. err: <nil> Duration: 8.049013617s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)