Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............X.....X..X.X...XXX....X.X....X.X....X.........] duration: 5.36145046s FAIL (2025-08-28 04:17:28 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.361479907s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.......................X....X.........] duration: 5.858712486s FAIL (2025-08-28 04:17:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.858811656s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.............X...X..........] duration: 2.117399982s FAIL (2025-08-28 04:16:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.117429339s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [................X....X.X.....X...X.........X................] duration: 1.483509476s FAIL (2025-08-28 04:16:51 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.483534363s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............X.....X..X.X...XXX....X.X....X.X....X........] duration: 4.86130005s FAIL (2025-08-28 04:16:31 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.86133125s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X.......................X....X........] duration: 6.14716093s FAIL (2025-08-28 04:16:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.147187291s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.............X...X.........] duration: 2.077989039s FAIL (2025-08-28 04:15:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.078014036s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.................X....X.X.....X...X.........X...............] duration: 1.411844553s FAIL (2025-08-28 04:15:43 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.411872326s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................X.....X..X.X...XXX....X.X....X.X....X.......] duration: 10.009017769s FAIL (2025-08-28 04:15:35 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 10.009048737s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.............X...X........] duration: 2.061365789s FAIL (2025-08-28 04:15:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.061397701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..................X....X.X.....X...X.........X..............] duration: 1.518819752s FAIL (2025-08-28 04:15:11 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.518848087s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.......................X....X.......] duration: 5.968557407s FAIL (2025-08-28 04:15:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.968589789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.............X...X.......] duration: 2.073558574s FAIL (2025-08-28 04:14:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.073578381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...................X....X.X.....X...X.........X.............] duration: 1.422845213s FAIL (2025-08-28 04:14:53 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.422873859s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.................X.....X..X.X...XXX....X.X....X.X....X......] duration: 5.237346636s FAIL (2025-08-28 04:14:30 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.237378015s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.............X...X......] duration: 2.492633993s FAIL (2025-08-28 04:14:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.492660604s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [....................X....X.X.....X...X.........X............] duration: 13.308749194s FAIL (2025-08-28 04:14:22 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 13.30877822s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X.......................X....X......] duration: 5.819007619s FAIL (2025-08-28 04:14:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.819039109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................X.....X..X.X...XXX....X.X....X.X....X.....] duration: 5.051287626s FAIL (2025-08-28 04:13:52 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.051316131s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................X.....X..X.X...XXX....X.X....X.X....X....] duration: 5.211040719s FAIL (2025-08-28 04:13:33 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.211069803s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.......................X....X.....] duration: 6.026020063s FAIL (2025-08-28 04:13:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.026055452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.............X...X.....] duration: 2.260780916s FAIL (2025-08-28 04:13:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.260806776s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....................X....X.X.....X...X.........X...........] duration: 1.43124643s FAIL (2025-08-28 04:13:14 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.431270084s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....................X.....X..X.X...XXX....X.X....X.X....X...] duration: 14.436644844s FAIL (2025-08-28 04:13:03 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 14.436684059s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [......................X....X.X.....X...X.........X..........] duration: 16.644012422s FAIL (2025-08-28 04:12:48 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 16.644039744s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.......................X....X....] duration: 6.001400966s FAIL (2025-08-28 04:12:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.001429099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.............X...X....] duration: 2.164576667s FAIL (2025-08-28 04:12:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.16460526s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....................X.....X..X.X...XXX....X.X....X.X....X..] duration: 4.903541821s FAIL (2025-08-28 04:12:19 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.903559726s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.......................X....X...] duration: 5.801115422s FAIL (2025-08-28 04:12:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.801142034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......................X.....X..X.X...XXX....X.X....X.X....X.] duration: 4.95619267s FAIL (2025-08-28 04:11:46 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.956211836s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.............X...X...] duration: 2.001047751s FAIL (2025-08-28 04:11:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.001075953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......................X.....X..X.X...XXX....X.X....X.X....X] duration: 30.004077327s FAIL (2025-08-28 04:11:41 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.004106554s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X.......................X....X..] duration: 5.806854775s FAIL (2025-08-28 04:11:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.806880243s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......................X....X.X.....X...X.........X.........] duration: 1.507576688s FAIL (2025-08-28 04:11:28 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.50760896s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [........................X....X.X.....X...X.........X........] duration: 26.759326043s FAIL (2025-08-28 04:11:26 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 26.759355949s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [........................X.....X..X.X...XXX....X.X....X.X....] duration: 5.084658173s FAIL (2025-08-28 04:10:58 UTC) orbiter warning: operation: sync2.Copy uplink: context deadline exceeded Duration: 5.084689162s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.......................X....X.] duration: 5.921558213s FAIL (2025-08-28 04:10:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.921580766s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.............X...X..] duration: 1.900254327s FAIL (2025-08-28 04:10:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 1.900280277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........................X....X.X.....X...X.........X.......] duration: 1.450402053s FAIL (2025-08-28 04:10:36 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.450425229s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.........................X.....X..X.X...XXX....X.X....X.X...] duration: 5.335763288s FAIL (2025-08-28 04:10:23 UTC) orbiter warning: operation: sync2.Copy uplink: context deadline exceeded Duration: 5.335789478s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.............X...X.] duration: 1.944075733s FAIL (2025-08-28 04:10:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 1.944109597s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........................X....X.X.....X...X.........X......] duration: 1.423062878s FAIL (2025-08-28 04:09:42 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.423087917s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........................X.....X..X.X...XXX....X.X....X.X..] duration: 4.859012153s FAIL (2025-08-28 04:09:38 UTC) orbiter warning: operation: sync2.Copy uplink: context deadline exceeded Duration: 4.859043333s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.......................X....X] duration: 4.159040047s FAIL (2025-08-28 04:09:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 4.159064414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X.............X...X] duration: 1.664556606s FAIL (2025-08-28 04:09:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 1.664582184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.............X...] duration: 1.951596362s FAIL (2025-08-28 04:08:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:06:16.838647525 (10h27m56.001248463s) [upload=10955]: Starting upload Aug 28 04:06:16.838721075 (10h27m56.001322013s) [upload=10955]: Done starting upload Aug 28 04:06:16.838776211 (10h27m56.001377149s) [upload=10955]: Uploading segments... Aug 28 04:06:16.838813302 (10h27m56.00141424s) [upload=10955]: Got next segment. Inline: true Aug 28 04:06:16.838817791 (10h27m56.001418729s) [upload=10955]: Waiting for error group managing segments... Aug 28 04:06:16.838853038 (10h27m56.001453976s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:06:16.838857506 (10h27m56.001458444s) [upload=10955]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:06:16.838860311 (10h27m56.00146125s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:06:17.075949559 (10h27m56.238550547s) [upload=10955]: Done uploading segments... Aug 28 04:06:17.075972433 (10h27m56.238573401s) [upload=10955]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.951624015s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........................X....X.X.....X...X.........X.....] duration: 1.451693516s FAIL (2025-08-28 04:08:38 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.451719726s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.............X..] duration: 2.207211219s FAIL (2025-08-28 04:08:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:06:16.838647525 (10h27m56.001248463s) [upload=10955]: Starting upload Aug 28 04:06:16.838721075 (10h27m56.001322013s) [upload=10955]: Done starting upload Aug 28 04:06:16.838776211 (10h27m56.001377149s) [upload=10955]: Uploading segments... Aug 28 04:06:16.838813302 (10h27m56.00141424s) [upload=10955]: Got next segment. Inline: true Aug 28 04:06:16.838817791 (10h27m56.001418729s) [upload=10955]: Waiting for error group managing segments... Aug 28 04:06:16.838853038 (10h27m56.001453976s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:06:16.838857506 (10h27m56.001458444s) [upload=10955]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:06:16.838860311 (10h27m56.00146125s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:06:17.075949559 (10h27m56.238550547s) [upload=10955]: Done uploading segments... Aug 28 04:06:17.075972433 (10h27m56.238573401s) [upload=10955]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.207239702s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.......................X....] duration: 5.655181053s FAIL (2025-08-28 04:08:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:05:53.289363958 (10h27m32.451964926s) [upload=10949]: Starting upload Aug 28 04:05:53.289458931 (10h27m32.452059869s) [upload=10949]: Done starting upload Aug 28 04:05:53.289544624 (10h27m32.452145562s) [upload=10949]: Uploading segments... Aug 28 04:05:53.289936975 (10h27m32.452537963s) [upload=10949]: Got next segment. Inline: false Aug 28 04:05:53.289966621 (10h27m32.452567549s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:05:53.289970921 (10h27m32.452571859s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:05:53.759704708 (10h27m32.922305646s) [seg_pos={0 0}, upload=10949]: Begin upload segment... Aug 28 04:05:53.759750246 (10h27m32.922351184s) [seg_pos={0 0}, upload=10949]: Done begin upload segment. Aug 28 04:05:53.759780604 (10h27m32.922381542s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.759788739 (10h27m32.922389687s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760165330 (10h27m32.922766268s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760461617 (10h27m32.923062555s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760596666 (10h27m32.923197614s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760761020 (10h27m32.923361958s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761018753 (10h27m32.923619691s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761291374 (10h27m32.923892312s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761498942 (10h27m32.92409988s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761698784 (10h27m32.924299722s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761945757 (10h27m32.924546695s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762179363 (10h27m32.924780292s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762210724 (10h27m32.924811652s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762367984 (10h27m32.924968922s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762556545 (10h27m32.925157483s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762667858 (10h27m32.925268796s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762774853 (10h27m32.925375791s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.763080417 (10h27m32.925681355s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:54.882306217 (10h27m34.044907155s) [upload=10949]: Next returned nil segment Aug 28 04:05:54.882324662 (10h27m34.0449256s) [upload=10949]: Waiting for error group managing segments... Aug 28 04:05:55.176815078 (10h27m34.339416056s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.178010275 (10h27m34.340611223s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.190745574 (10h27m34.353346512s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.603281813 (10h27m34.765882751s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.657161975 (10h27m34.819762913s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.671217149 (10h27m34.833818087s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.702955241 (10h27m34.865556169s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.707816403 (10h27m34.870417341s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.728970733 (10h27m34.891571681s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.742514249 (10h27m34.905115187s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.755299383 (10h27m34.917900321s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.794179992 (10h27m34.95678093s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.834967951 (10h27m34.997568889s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846294364 (10h27m35.008895302s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846322088 (10h27m35.008923026s) [seg_pos={0 0}, upload=10949]: Segment reached optimal threshold of 14 pieces. Aug 28 04:05:55.846431748 (10h27m35.009032686s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846493265 (10h27m35.009094203s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dFsmPBv2oP7W7uKnJFpKMcJDSQ3BEGLaPZ23eX3Cqze8UgDSs): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846545676 (10h27m35.009146604s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846576364 (10h27m35.009177302s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846601863 (10h27m35.009202801s) [seg_pos={0 0}, upload=10949]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:05:55.846697305 (10h27m35.009298253s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:05:55.846703988 (10h27m35.009304956s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:05:56.185002402 (10h27m35.34760334s) [upload=10949]: Done uploading segments... Aug 28 04:05:56.185020596 (10h27m35.347621534s) [upload=10949]: Upload finished. err: <nil> Duration: 5.655200711s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........................X.....X..X.X...XXX....X.X....X.X.] duration: 5.111012181s FAIL (2025-08-28 04:08:23 UTC) orbiter warning: operation: sync2.Copy uplink: context deadline exceeded Duration: 5.111027599s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)