Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........................................X....X.X.....X...X.] duration: 1.510963114s FAIL (2025-08-28 03:58:02 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.510980297s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........................................X....X.X.....X...X] duration: 30.000714005s FAIL (2025-08-28 03:58:00 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.000738631s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X..............................................X....] duration: 2.058466172s FAIL (2025-08-28 03:57:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.058489266s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.883130748s FAIL (2025-08-28 03:57:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.883161447s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........................................X.....X..X.X...XXX.] duration: 4.93298009s FAIL (2025-08-28 03:57:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.933011069s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........................................X.....X..X.X...XXX] duration: 31.719676389s FAIL (2025-08-28 03:57:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 31.719704301s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X..............................................X...] duration: 1.906362606s FAIL (2025-08-28 03:57:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.90639621s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.841756162s FAIL (2025-08-28 03:57:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.841786221s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................................X....X.X.....X...] duration: 26.432672666s FAIL (2025-08-28 03:56:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 26.432695961s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X..............................................X..] duration: 1.928834043s FAIL (2025-08-28 03:56:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.928857669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [...........................................X.....X..X.X...XX] duration: 30.004900275s FAIL (2025-08-28 03:56:31 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.004927487s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.691956413s FAIL (2025-08-28 03:56:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.691983894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 5 out of 60 is failed (threshold=3) [............................................X.....X..X.X...X] duration: 30.003180432s FAIL (2025-08-28 03:55:51 UTC) orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded Duration: 30.00319983s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X..............................................X.] duration: 1.94504494s FAIL (2025-08-28 03:55:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.9450657s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.916588657s FAIL (2025-08-28 03:55:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.916614947s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [............................................X....X.X.....X..] duration: 1.417263509s FAIL (2025-08-28 03:55:15 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.417313455s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.801785863s FAIL (2025-08-28 03:54:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.801812594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X....X.X.....X.] duration: 1.659569619s FAIL (2025-08-28 03:54:40 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.659591262s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X..............................................X] duration: 1.430247771s FAIL (2025-08-28 03:54:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.430313107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................................X.....X..X.X...] duration: 5.065438587s FAIL (2025-08-28 03:54:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.065504742s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [X.............................................X....X.X.....X] duration: 30.001305895s FAIL (2025-08-28 03:54:19 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.001328226s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.973054319s FAIL (2025-08-28 03:54:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.973079908s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.136113693s FAIL (2025-08-28 03:54:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.136140164s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.673969356s FAIL (2025-08-28 03:53:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.673999815s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.............................................X.....X..X.X..] duration: 27.373528059s FAIL (2025-08-28 03:53:43 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 27.373555102s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.004986585s FAIL (2025-08-28 03:53:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.005007775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.............................................X....X.X.....] duration: 1.46461375s FAIL (2025-08-28 03:52:58 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.464704893s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.............................................X....X.X....] duration: 1.43924667s FAIL (2025-08-28 03:52:36 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.439273342s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.693954456s FAIL (2025-08-28 03:52:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.693974053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XX.............................................X.....X..X.X.] duration: 5.317011779s FAIL (2025-08-28 03:52:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.317038962s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.915958811s FAIL (2025-08-28 03:52:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.916023895s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.............................................X....X.X...] duration: 1.396692128s FAIL (2025-08-28 03:52:02 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.396728086s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.885861248s FAIL (2025-08-28 03:51:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.885887368s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.XX.............................................X.....X..X.X] duration: 30.002681069s FAIL (2025-08-28 03:51:51 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.002704675s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.............................................X....X.X..] duration: 25.476725998s FAIL (2025-08-28 03:51:43 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 25.476754623s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..XX.............................................X.....X..X.] duration: 5.053437815s FAIL (2025-08-28 03:51:09 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.053466881s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.931515103s FAIL (2025-08-28 03:51:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.931562274s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [X....X.............................................X....X.X.] duration: 1.56263877s FAIL (2025-08-28 03:51:01 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.562674389s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.981521612s FAIL (2025-08-28 03:50:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.981558272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...XX.............................................X.....X..X] duration: 30.007067689s FAIL (2025-08-28 03:50:53 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.007090672s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.892293224s FAIL (2025-08-28 03:50:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.892323683s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [XX....X.............................................X....X.X] duration: 30.000705197s FAIL (2025-08-28 03:50:27 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.000729443s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.023872716s FAIL (2025-08-28 03:49:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 6.023899718s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....XX.............................................X.....X..] duration: 5.274516939s FAIL (2025-08-28 03:49:47 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.274537589s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.XX....X.............................................X....X.] duration: 1.413928436s FAIL (2025-08-28 03:49:39 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.413979675s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.016155819s FAIL (2025-08-28 03:49:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 6.016185455s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.985170427s FAIL (2025-08-28 03:49:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:18:05.467703419 (9h39m44.630304377s) [upload=10114]: Starting upload Aug 28 03:18:05.467798450 (9h39m44.630399418s) [upload=10114]: Done starting upload Aug 28 03:18:05.467888944 (9h39m44.630489932s) [upload=10114]: Uploading segments... Aug 28 03:18:05.467959088 (9h39m44.630560066s) [upload=10114]: Got next segment. Inline: true Aug 28 03:18:05.467967052 (9h39m44.630568031s) [upload=10114]: Waiting for error group managing segments... Aug 28 03:18:05.468027860 (9h39m44.630628848s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:18:05.468035835 (9h39m44.630636813s) [upload=10114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:18:05.468041766 (9h39m44.630642754s) [upload=10114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:18:05.691590395 (9h39m44.854191333s) [upload=10114]: Done uploading segments... Aug 28 03:18:05.691608059 (9h39m44.854208997s) [upload=10114]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.985196196s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [..XX....X.............................................X....X] duration: 30.000752178s FAIL (2025-08-28 03:49:15 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.000775302s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....XX.............................................X.....X.] duration: 5.074041158s FAIL (2025-08-28 03:49:06 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.074059584s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......XX.............................................X.....X] duration: 30.004497271s FAIL (2025-08-28 03:49:01 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.004524695s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)