Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [X...XXX....X.X....X.X....X..................................] duration: 4.913314254s FAIL (2025-08-28 04:36:10 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.913341657s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X.............X...X..............................X....X] duration: 1.434862232s FAIL (2025-08-28 04:35:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 04:35:41.675993301 (10h57m20.838594239s) [upload=11479]: Starting upload Aug 28 04:35:41.676037576 (10h57m20.838638514s) [upload=11479]: Done starting upload Aug 28 04:35:41.676085898 (10h57m20.838686836s) [upload=11479]: Uploading segments... Aug 28 04:35:41.676117018 (10h57m20.838717946s) [upload=11479]: Got next segment. Inline: true Aug 28 04:35:41.676120555 (10h57m20.838721493s) [upload=11479]: Waiting for error group managing segments... Aug 28 04:35:41.676152616 (10h57m20.838753544s) [upload=11479]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:35:41.676156844 (10h57m20.838757782s) [upload=11479]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:35:41.676159248 (10h57m20.838760186s) [upload=11479]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:35:41.951871223 (10h57m21.114472161s) [upload=11479]: Done uploading segments... Aug 28 04:35:41.951893956 (10h57m21.114494894s) [upload=11479]: Upload finished. err: <nil> Duration:* 1.434906357s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X.............X...X..............................X....] duration: 1.946993865s FAIL (2025-08-28 04:35:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:32:47.935722241 (10h54m27.098323179s) [upload=11424]: Starting upload Aug 28 04:32:47.935823235 (10h54m27.098424173s) [upload=11424]: Done starting upload Aug 28 04:32:47.935877238 (10h54m27.098478176s) [upload=11424]: Uploading segments... Aug 28 04:32:47.935919628 (10h54m27.098520567s) [upload=11424]: Got next segment. Inline: true Aug 28 04:32:47.935924107 (10h54m27.098525045s) [upload=11424]: Waiting for error group managing segments... Aug 28 04:32:47.935959265 (10h54m27.098560203s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:32:47.935963693 (10h54m27.098564631s) [upload=11424]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:32:47.935966338 (10h54m27.098567276s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:32:48.177036496 (10h54m27.339637424s) [upload=11424]: Done uploading segments... Aug 28 04:32:48.177054331 (10h54m27.339655259s) [upload=11424]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.947020547s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X....X.................................] duration: 5.888364404s FAIL (2025-08-28 04:35:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.888458235s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.X...XXX....X.X....X.X....X.................................] duration: 7.016759153s FAIL (2025-08-28 04:35:10 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 7.016839849s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...X.........X.........................................] duration: 1.54561795s FAIL (2025-08-28 04:35:00 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.545651977s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X....X................................] duration: 5.697034262s FAIL (2025-08-28 04:34:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.697060831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 10 out of 60 is failed (threshold=3) [X.X...XXX....X.X....X.X....X................................] duration: 5.204257582s FAIL (2025-08-28 04:34:42 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.20428845s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...X.........X........................................] duration: 5.89329103s FAIL (2025-08-28 04:34:40 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.893309044s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.....X...X.........X.......................................] duration: 1.571842188s FAIL (2025-08-28 04:34:16 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.571907862s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X.............X...X..............................X...] duration: 2.147927555s FAIL (2025-08-28 04:34:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:32:47.935722241 (10h54m27.098323179s) [upload=11424]: Starting upload Aug 28 04:32:47.935823235 (10h54m27.098424173s) [upload=11424]: Done starting upload Aug 28 04:32:47.935877238 (10h54m27.098478176s) [upload=11424]: Uploading segments... Aug 28 04:32:47.935919628 (10h54m27.098520567s) [upload=11424]: Got next segment. Inline: true Aug 28 04:32:47.935924107 (10h54m27.098525045s) [upload=11424]: Waiting for error group managing segments... Aug 28 04:32:47.935959265 (10h54m27.098560203s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:32:47.935963693 (10h54m27.098564631s) [upload=11424]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:32:47.935966338 (10h54m27.098567276s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:32:48.177036496 (10h54m27.339637424s) [upload=11424]: Done uploading segments... Aug 28 04:32:48.177054331 (10h54m27.339655259s) [upload=11424]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.147980396s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X.............X...X..............................X..] duration: 2.079413247s FAIL (2025-08-28 04:33:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:32:47.935722241 (10h54m27.098323179s) [upload=11424]: Starting upload Aug 28 04:32:47.935823235 (10h54m27.098424173s) [upload=11424]: Done starting upload Aug 28 04:32:47.935877238 (10h54m27.098478176s) [upload=11424]: Uploading segments... Aug 28 04:32:47.935919628 (10h54m27.098520567s) [upload=11424]: Got next segment. Inline: true Aug 28 04:32:47.935924107 (10h54m27.098525045s) [upload=11424]: Waiting for error group managing segments... Aug 28 04:32:47.935959265 (10h54m27.098560203s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:32:47.935963693 (10h54m27.098564631s) [upload=11424]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:32:47.935966338 (10h54m27.098567276s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:32:48.177036496 (10h54m27.339637424s) [upload=11424]: Done uploading segments... Aug 28 04:32:48.177054331 (10h54m27.339655259s) [upload=11424]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.079445399s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.X.X...XXX....X.X....X.X....X...............................] duration: 4.779678387s FAIL (2025-08-28 04:33:45 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.779707522s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X....X...............................] duration: 6.134147391s FAIL (2025-08-28 04:33:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.134176458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.....X...X.........X......................................] duration: 1.610664393s FAIL (2025-08-28 04:33:17 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.610695302s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.......................X....X..............................] duration: 5.880865506s FAIL (2025-08-28 04:33:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.880923886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X.............X...X..............................X.] duration: 2.067587567s FAIL (2025-08-28 04:33:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:32:47.935722241 (10h54m27.098323179s) [upload=11424]: Starting upload Aug 28 04:32:47.935823235 (10h54m27.098424173s) [upload=11424]: Done starting upload Aug 28 04:32:47.935877238 (10h54m27.098478176s) [upload=11424]: Uploading segments... Aug 28 04:32:47.935919628 (10h54m27.098520567s) [upload=11424]: Got next segment. Inline: true Aug 28 04:32:47.935924107 (10h54m27.098525045s) [upload=11424]: Waiting for error group managing segments... Aug 28 04:32:47.935959265 (10h54m27.098560203s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:32:47.935963693 (10h54m27.098564631s) [upload=11424]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:32:47.935966338 (10h54m27.098567276s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:32:48.177036496 (10h54m27.339637424s) [upload=11424]: Done uploading segments... Aug 28 04:32:48.177054331 (10h54m27.339655259s) [upload=11424]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.067617524s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..X.X...XXX....X.X....X.X....X..............................] duration: 4.8270552s FAIL (2025-08-28 04:32:50 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.827075588s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X.............X...X..............................X] duration: 975.73963ms FAIL (2025-08-28 04:32:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:32:47.935722241 (10h54m27.098323179s) [upload=11424]: Starting upload Aug 28 04:32:47.935823235 (10h54m27.098424173s) [upload=11424]: Done starting upload Aug 28 04:32:47.935877238 (10h54m27.098478176s) [upload=11424]: Uploading segments... Aug 28 04:32:47.935919628 (10h54m27.098520567s) [upload=11424]: Got next segment. Inline: true Aug 28 04:32:47.935924107 (10h54m27.098525045s) [upload=11424]: Waiting for error group managing segments... Aug 28 04:32:47.935959265 (10h54m27.098560203s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:32:47.935963693 (10h54m27.098564631s) [upload=11424]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:32:47.935966338 (10h54m27.098567276s) [upload=11424]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:32:48.177036496 (10h54m27.339637424s) [upload=11424]: Done uploading segments... Aug 28 04:32:48.177054331 (10h54m27.339655259s) [upload=11424]: Upload finished. err: metaclient: Too Many Requests Duration:* 975.777713ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X..X.X...XXX....X.X....X.X....X.............................] duration: 4.871061596s FAIL (2025-08-28 04:32:34 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.871088718s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.......................X....X.............................] duration: 6.015500192s FAIL (2025-08-28 04:32:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.015532934s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X.............X...X..............................] duration: 2.598168132s FAIL (2025-08-28 04:32:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.598197036s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [X.X.....X...X.........X.....................................] duration: 13.239280854s FAIL (2025-08-28 04:32:17 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 13.23931559s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X.............X...X.............................] duration: 2.288010427s FAIL (2025-08-28 04:31:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.288046386s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X..X.X...XXX....X.X....X.X....X............................] duration: 4.968656568s FAIL (2025-08-28 04:31:49 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 4.968677038s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.......................X....X............................] duration: 5.978851447s FAIL (2025-08-28 04:31:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.97888412s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X.............X...X............................] duration: 2.089237676s FAIL (2025-08-28 04:31:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.089261903s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X.X.....X...X.........X....................................] duration: 1.482889963s FAIL (2025-08-28 04:31:27 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.482927085s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X.............X...X...........................] duration: 2.049357636s FAIL (2025-08-28 04:30:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.049386319s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.......................X....X...........................] duration: 5.94962395s FAIL (2025-08-28 04:30:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 5.949654089s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..X..X.X...XXX....X.X....X.X....X...........................] duration: 5.095825781s FAIL (2025-08-28 04:30:37 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.095855357s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X.X.....X...X.........X...................................] duration: 1.431893871s FAIL (2025-08-28 04:30:27 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.431923608s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X.X.....X...X.........X..................................] duration: 4.915235378s FAIL (2025-08-28 04:30:15 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.915264416s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X.............X...X..........................] duration: 2.376295186s FAIL (2025-08-28 04:29:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.376315286s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X.X.....X...X.........X.................................] duration: 2.080171676s FAIL (2025-08-28 04:29:35 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.080193026s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.......................X....X..........................] duration: 6.087934983s FAIL (2025-08-28 04:29:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.087961345s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...X..X.X...XXX....X.X....X.X....X..........................] duration: 5.017613586s FAIL (2025-08-28 04:29:33 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.017638103s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [X....X.X.....X...X.........X................................] duration: 2.86251092s FAIL (2025-08-28 04:29:15 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.862541618s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.......................X....X.........................] duration: 6.448664985s FAIL (2025-08-28 04:28:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.448690695s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.............X...X.........................] duration: 2.030364432s FAIL (2025-08-28 04:28:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.030392727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [....X..X.X...XXX....X.X....X.X....X.........................] duration: 5.016876715s FAIL (2025-08-28 04:28:25 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.016904649s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.............X...X........................] duration: 2.058875517s FAIL (2025-08-28 04:28:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.058896627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.X....X.X.....X...X.........X...............................] duration: 2.265486578s FAIL (2025-08-28 04:28:14 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.265517196s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.......................X....X........................] duration: 6.306594522s FAIL (2025-08-28 04:28:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.306622607s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.............X...X.......................] duration: 2.094396894s FAIL (2025-08-28 04:27:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.094427372s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.....X..X.X...XXX....X.X....X.X....X........................] duration: 5.13183471s FAIL (2025-08-28 04:27:45 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.131865749s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.............X...X......................] duration: 2.216122403s FAIL (2025-08-28 04:27:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after be94eaa104ef8782596d1a3e18f5b56219f886f8124e849f644856f2e18fab31 != before b92f5856f0e03876ce56930bb68367b5670cf4879e09fba07dabcd5d5ee7db76 ======LOGS====== Aug 28 04:09:27.575310385 (10h31m6.737911323s) [upload=11009]: Starting upload Aug 28 04:09:27.575357656 (10h31m6.737958594s) [upload=11009]: Done starting upload Aug 28 04:09:27.575429543 (10h31m6.738030481s) [upload=11009]: Uploading segments... Aug 28 04:09:27.575463789 (10h31m6.738064727s) [upload=11009]: Got next segment. Inline: true Aug 28 04:09:27.575476783 (10h31m6.738077711s) [upload=11009]: Waiting for error group managing segments... Aug 28 04:09:27.575510978 (10h31m6.738111916s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:27.575515368 (10h31m6.738116296s) [upload=11009]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:09:27.575518123 (10h31m6.738119061s) [upload=11009]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:27.856146662 (10h31m7.0187476s) [upload=11009]: Done uploading segments... Aug 28 04:09:27.856166521 (10h31m7.018767459s) [upload=11009]: Upload finished. err: <nil> Duration:* 2.216150367s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.......................X....X.......................] duration: 6.104922487s FAIL (2025-08-28 04:27:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:09:30.886391779 (10h31m10.048992717s) [upload=11010]: Starting upload Aug 28 04:09:30.886441775 (10h31m10.049042713s) [upload=11010]: Done starting upload Aug 28 04:09:30.886518221 (10h31m10.049119159s) [upload=11010]: Uploading segments... Aug 28 04:09:30.886615527 (10h31m10.049216465s) [upload=11010]: Got next segment. Inline: false Aug 28 04:09:30.886643771 (10h31m10.049244709s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:09:30.886648290 (10h31m10.049249218s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:09:31.350126157 (10h31m10.512727095s) [seg_pos={0 0}, upload=11010]: Begin upload segment... Aug 28 04:09:31.350173328 (10h31m10.512774266s) [seg_pos={0 0}, upload=11010]: Done begin upload segment. Aug 28 04:09:31.350194808 (10h31m10.512795746s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350262588 (10h31m10.512863526s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350589564 (10h31m10.513190502s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.350785839 (10h31m10.513386778s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351131832 (10h31m10.51373277s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351152571 (10h31m10.513753509s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351411807 (10h31m10.514012745s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351613433 (10h31m10.514214371s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351669570 (10h31m10.514270508s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351907245 (10h31m10.514508183s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.351918266 (10h31m10.514519205s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352163235 (10h31m10.514764173s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352178825 (10h31m10.514779763s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352402483 (10h31m10.515003421s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352446117 (10h31m10.515047055s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352606424 (10h31m10.515207362s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.352701054 (10h31m10.515301992s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:31.353636734 (10h31m10.516237672s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Uploading piece... Aug 28 04:09:32.493645112 (10h31m11.65624604s) [upload=11010]: Next returned nil segment Aug 28 04:09:32.493661383 (10h31m11.656262321s) [upload=11010]: Waiting for error group managing segments... Aug 28 04:09:32.799891633 (10h31m11.962492571s) [noise=true , address=79.127.205.245:4239 , piece_id=MGBC3CVBNNCLFVQ7JALPHKQMJYPQ7I76QAJLYBDR4BML2V2JXQNA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:32.800177060 (10h31m11.962778048s) [noise=true , address=64.49.13.140:4508 , piece_id=37NOHX2G5QV46TY47ZC5XUWTQNQVEJTPRQ5PFIU7JK2PPWUNA63A, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.191063542 (10h31m12.35366448s) [noise=true , address=79.127.220.98:4398 , piece_id=RB3ANHFIDJYQEWCPVLPRGC7EUQRTAGEZOUO2QHFGWMI3YWQBQRKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.241450178 (10h31m12.404051116s) [noise=true , address=45.91.116.10:4093 , piece_id=RH2EAG2QWHTFKRHY6HWKTCNUAD3SXTSC54WQX6WY5AK2JNY2JWMA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.272332983 (10h31m12.434933921s) [noise=true , address=79.127.219.51:4196 , piece_id=V7QBMHKFDEFZSDR6AXMZB3CBUONJVJZQSSDHCZIUV7Q4J5MSBALQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.291140321 (10h31m12.453741269s) [noise=true , address=45.91.116.13:4175 , piece_id=QHMAU23F4QSXLYMQAXGPRZVRMIDK56LQUFH3WAAXG3INIQSJRNRQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.300576056 (10h31m12.463176984s) [noise=true , address=45.91.116.4:4951 , piece_id=WAS5G4272QNCSHPB75OZAVGZ36M3TLWKKV6YMF4GCLDPPKLDF4KQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.315823773 (10h31m12.478424711s) [noise=true , address=77.90.31.18:4838 , piece_id=QQ22KQMU3RHD7GSP2C7UFSNR4YY7JDQMRUPENZVB7Z3JSXW4AYWA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.357879117 (10h31m12.520480055s) [noise=true , address=104.36.82.60:4371 , piece_id=YR4LFTABK7W6FACBXA6FEOQQ4PRGQKXYSFCGCMSIK2ZEFSCDW4PA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405213313 (10h31m12.567814251s) [noise=true , address=77.90.31.17:4790 , piece_id=4NBFHN6VOY5KZDENSFBQHMX6WLUTSZNGWD2SD3LAMMJODT3YSG2Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.405519689 (10h31m12.568120627s) [noise=true , address=104.36.82.44:4886 , piece_id=FVJS5HSITAMO5WBIQ2Y3QO4KJ55HFEWFPHR4ZI5OQOWXPGNQGUDA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.417905670 (10h31m12.580506608s) [noise=true , address=77.90.31.19:4865 , piece_id=EC7VIPY5VUKKTTRRA53CAMHWVCCNQCGPY7CPSXUEN66VM765B6QQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.449266940 (10h31m12.611867879s) [noise=true , address=79.127.201.215:4357 , piece_id=3VILX6AXHMF2TIEW7TXNOOFOFAHNGT3KUUN4NLQL2ODAJ32BMQ7Q, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471617319 (10h31m12.634218257s) [noise=true , address=45.91.116.9:4281 , piece_id=C2PLNYEYEKYZ4KIQTOK6SN2UYGEKMQKF5MDHBBOH4M57E4BUQMEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: <nil> Aug 28 04:09:33.471645703 (10h31m12.634246641s) [seg_pos={0 0}, upload=11010]: Segment reached optimal threshold of 14 pieces. Aug 28 04:09:33.471759380 (10h31m12.634360308s) [noise=true , address=77.90.31.12:4612 , piece_id=C64SDLHLTUZ5JEPRLDTYONOPRVEIU2VHKXH76ZWSAO34TQD2XFEQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471812632 (10h31m12.63441357s) [noise=true , address=77.90.31.16:4742 , piece_id=M7V4CMWSZS3MIR7LS2SW6UVVFVYCPXTG2HSM37YW7DPMZ3MBERAQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471875743 (10h31m12.634476691s) [noise=true , address=104.36.82.44:4870 , piece_id=GB6Q3GICXYY7JE5VGG54FM7WHFAS5WQS4FZAROHK4WEI2EXOXUKQ, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471922753 (10h31m12.634523691s) [noise=true , address=77.90.31.10:4531 , piece_id=BQTOXS3EXA7GIZYPCZKRSNVG7NF3AXW6FT4P5YBVIUHO76TGXSSA, seg_pos={0 0}, upload=11010]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF Aug 28 04:09:33.471968090 (10h31m12.634569028s) [seg_pos={0 0}, upload=11010]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:09:33.472067570 (10h31m12.634668498s) [upload=11010]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:09:33.472072188 (10h31m12.634673116s) [upload=11010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:09:33.915288927 (10h31m13.077889865s) [upload=11010]: Done uploading segments... Aug 28 04:09:33.915307873 (10h31m13.077908811s) [upload=11010]: Upload finished. err: <nil> Duration: 6.104952945s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 12 out of 60 is failed (threshold=3) [X.....X..X.X...XXX....X.X....X.X....X.......................] duration: 5.023905945s FAIL (2025-08-28 04:27:21 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 5.023935793s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X....X.X.....X...X.........X..............................] duration: 1.418759662s FAIL (2025-08-28 04:27:04 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.418791022s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)