Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.X.....X..X.X...XXX....X.X....X.X....X......................] duration: 6.700419916s FAIL (2025-08-28 04:26:56 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 6.700451036s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.......................X....X......................] duration: 5.835728925s FAIL (2025-08-28 04:26:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.83575678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.............X...X.....................] duration: 1.909402887s FAIL (2025-08-28 04:26:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 1.909432475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..X.....X..X.X...XXX....X.X....X.X....X.....................] duration: 4.853789936s FAIL (2025-08-28 04:26:19 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.853823139s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X....X.X.....X...X.........X.............................] duration: 1.432836045s FAIL (2025-08-28 04:26:08 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.432864911s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.......................X....X.....................] duration: 5.650518526s FAIL (2025-08-28 04:25:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.650609689s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...X.....X..X.X...XXX....X.X....X.X....X....................] duration: 5.22483051s FAIL (2025-08-28 04:25:42 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.22486195s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [....X....X.X.....X...X.........X............................] duration: 2.706068144s FAIL (2025-08-28 04:25:31 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.706095588s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.......................X....X....................] duration: 5.903505404s FAIL (2025-08-28 04:25:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.903532015s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.............X...X....................] duration: 2.088194527s FAIL (2025-08-28 04:25:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.088224715s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X....X.X.....X...X.........X...........................] duration: 1.382907759s FAIL (2025-08-28 04:25:06 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.382943809s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.......................X....X...................] duration: 5.883139777s FAIL (2025-08-28 04:24:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.883171166s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....X.....X..X.X...XXX....X.X....X.X....X...................] duration: 5.596063066s FAIL (2025-08-28 04:24:42 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.596089017s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.............X...X...................] duration: 2.095701283s FAIL (2025-08-28 04:24:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.095727793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X....X.X.....X...X.........X..........................] duration: 1.424747399s FAIL (2025-08-28 04:24:14 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.424778619s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.......................X....X..................] duration: 5.783857443s FAIL (2025-08-28 04:24:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.783884396s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.............X...X..................] duration: 2.123698776s FAIL (2025-08-28 04:23:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.12375813s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.......................X....X.................] duration: 5.975239996s FAIL (2025-08-28 04:23:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.975273781s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....X.....X..X.X...XXX....X.X....X.X....X..................] duration: 4.981830486s FAIL (2025-08-28 04:23:39 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.981852138s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X....X.X.....X...X.........X.........................] duration: 3.378040837s FAIL (2025-08-28 04:23:28 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.378071536s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.............X...X.................] duration: 2.050160091s FAIL (2025-08-28 04:23:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.050186863s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X....X.X.....X...X.........X........................] duration: 2.624038324s FAIL (2025-08-28 04:23:09 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.624066287s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.......................X....X................] duration: 5.937856966s FAIL (2025-08-28 04:22:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.937883237s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......X.....X..X.X...XXX....X.X....X.X....X.................] duration: 5.248912538s FAIL (2025-08-28 04:22:34 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.248943849s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.............X...X................] duration: 2.029220593s FAIL (2025-08-28 04:22:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.029245781s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......X.....X..X.X...XXX....X.X....X.X....X................] duration: 5.057771121s FAIL (2025-08-28 04:22:10 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.057799013s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X....X.X.....X...X.........X.......................] duration: 1.901422437s FAIL (2025-08-28 04:22:10 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.9014456s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.......................X....X...............] duration: 5.999667443s FAIL (2025-08-28 04:22:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.999688393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X....X.X.....X...X.........X......................] duration: 1.486760049s FAIL (2025-08-28 04:21:46 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.486790315s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........X.....X..X.X...XXX....X.X....X.X....X...............] duration: 5.128416292s FAIL (2025-08-28 04:21:44 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.128446568s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.......................X....X..............] duration: 6.108800883s FAIL (2025-08-28 04:21:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.108830671s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........X.....X..X.X...XXX....X.X....X.X....X..............] duration: 5.138431013s FAIL (2025-08-28 04:21:07 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.138461852s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.............X...X...............] duration: 2.094863659s FAIL (2025-08-28 04:21:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.094905108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........X....X.X.....X...X.........X.....................] duration: 1.680531134s FAIL (2025-08-28 04:20:59 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.680560439s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.............X...X..............] duration: 2.167719421s FAIL (2025-08-28 04:20:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.167741072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.......................X....X.............] duration: 5.907251338s FAIL (2025-08-28 04:20:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.907282556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..........X.....X..X.X...XXX....X.X....X.X....X.............] duration: 5.290375457s FAIL (2025-08-28 04:19:59 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.290405596s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [............X....X.X.....X...X.........X....................] duration: 1.404862823s FAIL (2025-08-28 04:19:57 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.404890747s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.............X...X.............] duration: 2.071335216s FAIL (2025-08-28 04:19:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.071358651s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.......................X....X............] duration: 6.266253076s FAIL (2025-08-28 04:19:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.266279947s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...........X.....X..X.X...XXX....X.X....X.X....X............] duration: 4.924210751s FAIL (2025-08-28 04:19:01 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.924271537s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.............X...X............] duration: 2.247874379s FAIL (2025-08-28 04:18:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.247897874s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.............X....X.X.....X...X.........X...................] duration: 1.355708926s FAIL (2025-08-28 04:18:49 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.355737711s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.......................X....X...........] duration: 6.004777516s FAIL (2025-08-28 04:18:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.004816121s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..............X....X.X.....X...X.........X..................] duration: 1.483687566s FAIL (2025-08-28 04:18:34 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.483717704s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [............X.....X..X.X...XXX....X.X....X.X....X...........] duration: 5.795309032s FAIL (2025-08-28 04:18:27 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.795340993s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.......................X....X..........] duration: 5.88995575s FAIL (2025-08-28 04:18:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.889989626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.............X...X...........] duration: 2.378192546s FAIL (2025-08-28 04:18:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.378220601s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.............X.....X..X.X...XXX....X.X....X.X....X..........] duration: 5.083401588s FAIL (2025-08-28 04:17:56 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.083421475s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...............X....X.X.....X...X.........X.................] duration: 1.441395469s FAIL (2025-08-28 04:17:37 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.441416439s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)