Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.870481554s FAIL (2025-08-04 17:06:44 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.870511762s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X........................X..................................] duration: 6.00635411s FAIL (2025-08-04 17:06:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.006379097s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.290215716s FAIL (2025-08-04 17:06:11 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.2902488s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.764395034s FAIL (2025-08-04 17:06:06 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.764426014s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X........................X.................................] duration: 5.896273385s FAIL (2025-08-04 17:05:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.896321618s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.212231718s FAIL (2025-08-04 17:05:51 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.212251798s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.239670453s FAIL (2025-08-04 17:05:16 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.239702154s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.364112193s FAIL (2025-08-04 17:05:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.364134606s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.798649158s FAIL (2025-08-04 17:05:04 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.798674487s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X........................X................................] duration: 6.052952585s FAIL (2025-08-04 17:04:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.052975237s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.828753335s FAIL (2025-08-04 17:04:38 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.82878258s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.300196782s FAIL (2025-08-04 17:04:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.300218112s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.796235541s FAIL (2025-08-04 17:04:12 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.796257412s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.276261417s FAIL (2025-08-04 17:04:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.276666853s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..X........................X...............................] duration: 6.253570815s FAIL (2025-08-04 17:03:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.253643453s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.824617402s FAIL (2025-08-04 17:03:37 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.824645415s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.147730194s FAIL (2025-08-04 17:03:12 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 6.147759209s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.834681295s FAIL (2025-08-04 17:02:52 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.83470929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.267173492s FAIL (2025-08-04 17:02:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.267193319s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.94776749s FAIL (2025-08-04 17:02:50 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.947793258s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [XX..X........................X..............................] duration: 5.918314297s FAIL (2025-08-04 17:02:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.918336079s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.562772308s FAIL (2025-08-04 17:02:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.562793829s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.789298086s FAIL (2025-08-04 17:02:06 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.789318795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.XX..X........................X.............................] duration: 6.202306658s FAIL (2025-08-04 17:01:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.202332558s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.976380984s FAIL (2025-08-04 17:01:51 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.976418758s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.506646664s FAIL (2025-08-04 17:01:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.506666222s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.943968126s FAIL (2025-08-04 17:01:23 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.944000247s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.6362661s FAIL (2025-08-04 17:01:21 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.636294274s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.XX..X........................X............................] duration: 6.121517919s FAIL (2025-08-04 17:01:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.121543696s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.386266928s FAIL (2025-08-04 17:00:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.386362461s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.994687509s FAIL (2025-08-04 17:00:41 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.994706605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.756568238s FAIL (2025-08-04 17:00:39 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.756612091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.875927279s FAIL (2025-08-04 17:00:38 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.875957947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 5.811755359s FAIL (2025-08-04 16:59:59 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.811783414s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XX.XX..X........................X...........................] duration: 6.210237688s FAIL (2025-08-04 16:59:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.21026454s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.125151508s FAIL (2025-08-04 16:59:55 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.125174992s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.XX.XX..X........................X..........................] duration: 5.872177727s FAIL (2025-08-04 16:59:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.872204899s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.541634357s FAIL (2025-08-04 16:59:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.54166224s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.630932896s FAIL (2025-08-04 16:59:30 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.630975979s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [X.XX.XX..X........................X.........................] duration: 6.012821044s FAIL (2025-08-04 16:59:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.012837798s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 5.940478461s FAIL (2025-08-04 16:59:08 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.940502796s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.601118723s FAIL (2025-08-04 16:58:53 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.601150273s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.005716007s FAIL (2025-08-04 16:58:50 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.005741696s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.XXX.......................................................] duration: 5.771990539s FAIL (2025-08-04 16:58:41 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.772016899s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.316348393s FAIL (2025-08-04 16:58:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.316366688s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X.XX.XX..X........................X........................] duration: 5.811194712s FAIL (2025-08-04 16:58:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.811220272s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.398854173s FAIL (2025-08-04 16:57:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.398871527s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.XXX......................................................] duration: 5.75305712s FAIL (2025-08-04 16:57:46 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== 66.225.170:57862->104.36.82.13:4186: use of closed network connection Aug 4 16:18:29.634260260 (118h21m19.571918749s) [seg_pos={0 0}, upload=113704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Aug 4 16:18:29.864378444 (118h21m19.802036943s) [upload=113704]: Done uploading segments... Aug 4 16:18:29.864404103 (118h21m19.802062602s) [upload=113704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Aug 4 16:18:30.773685844 (118h21m20.711344333s) [upload=113714]: Starting upload Aug 4 16:18:30.773843035 (118h21m20.711501534s) [upload=113714]: Done starting upload Aug 4 16:18:30.773924561 (118h21m20.71158306s) [upload=113714]: Uploading segments... Aug 4 16:18:30.774094206 (118h21m20.711752695s) [upload=113714]: Got next segment. Inline: false Aug 4 16:18:30.774126056 (118h21m20.711784555s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 4 16:18:30.774130344 (118h21m20.711788843s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 4 16:18:31.011515803 (118h21m20.949174302s) [seg_pos={0 0}, upload=113714]: Begin upload segment... Aug 4 16:18:31.011581389 (118h21m20.949239898s) [seg_pos={0 0}, upload=113714]: Done begin upload segment. Aug 4 16:18:31.011604403 (118h21m20.949262912s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011720936 (118h21m20.949379435s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.011997064 (118h21m20.949655563s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012225821 (118h21m20.94988432s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012308239 (118h21m20.949966738s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012418300 (118h21m20.950076799s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012613513 (118h21m20.950272012s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012753160 (118h21m20.950411659s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.012811131 (118h21m20.95046963s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013004381 (118h21m20.95066287s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013163866 (118h21m20.950822365s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013531159 (118h21m20.951189658s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.013872873 (118h21m20.951531372s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.014172115 (118h21m20.951830614s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015248565 (118h21m20.952907064s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:31.015496128 (118h21m20.953154627s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Uploading piece... Aug 4 16:18:32.741770833 (118h21m22.679429352s) [upload=113714]: Next returned nil segment Aug 4 16:18:32.741792233 (118h21m22.679450763s) [upload=113714]: Waiting for error group managing segments... Aug 4 16:18:33.031304408 (118h21m22.968962907s) [noise=true , address=45.91.116.8:4045 , piece_id=YCPPIATKRNXMTWXGTCELS2EZPXRPC7RVZZT2YMZZHS6NUH2USLJA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.033040921 (118h21m22.97069942s) [noise=true , address=45.91.116.5:4298 , piece_id=2WPFWY3R5RJC2QO5BXP6IULTUM366JEDEYHEBQDUGPEKFYNEDWIQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.034686720 (118h21m22.972345209s) [noise=true , address=77.90.31.12:4589 , piece_id=AAMATJFUK77O6VQ4AF57WHRIGQQYUXRHEESXZFYFLPOHS2IGBFYQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.036548412 (118h21m22.974206911s) [noise=true , address=77.90.31.21:4877 , piece_id=YTBYW3NK4SXLO3CNQT7YND7XD2IKNN4OTWN6WYASBTJUIMPKUM2Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.059147582 (118h21m22.996806071s) [noise=true , address=77.90.31.15:4697 , piece_id=6PROJBDPAFJCBHAAQ45RQ2BDIDDUT2KD6UEQTTONFJ6INIK57YAA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.171247436 (118h21m23.108905935s) [noise=true , address=77.90.31.13:4628 , piece_id=PFEVUZQ4IX6Q7LHKD6VSEW6J2BA2GADLR53SRXIYIYL5XSCQCJNQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.219388326 (118h21m23.157046825s) [noise=true , address=104.36.82.10:4078 , piece_id=TQPRFOOXJMBYB5NMAXB3QZLQ5G5ABNARWYXEAAQEILVNM4FEYOBA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:33.997614596 (118h21m23.935273095s) [noise=true , address=77.90.31.21:4879 , piece_id=AXYOW2DPJQVDB4ZOURPUWC7Q3KPXXPVYV2V4E3SIFAQ27B7RY3XA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:34.018191777 (118h21m23.955850276s) [noise=true , address=104.36.82.7:4911 , piece_id=BJRLBG4JVK33LDNCJTEAVSQV4U772YELSTGYN6WH4QLPH5C6AJUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:44.685373447 (118h21m34.623031946s) [noise=true , address=77.90.31.14:4663 , piece_id=3L2HY4QB7EUZ4E4JEYKUPRBQF6QRE2TCFN255LMXAR3YBF4AE65Q, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:45.924412567 (118h21m35.862071066s) [noise=true , address=77.90.31.18:4806 , piece_id=3COKTLXWWA3ZSBCOYWYKT5GDUG6H5USPSHBFYVIOL4SKHIBI4CCA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:53.143254472 (118h21m43.080913011s) [noise=true , address=77.90.31.17:4770 , piece_id=TMEGOD5OLRWVC56VIWJTPP2WBFBBMEXWCKACT7K26T2HHARZNSQA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690047932 (118h21m47.627706431s) [noise=true , address=77.90.31.19:4841 , piece_id=23RE2PCFCBQOLS7JFWHAX7U3THWIA34JYDQGRV2SQEBJV4RYDDUA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: <nil> Aug 4 16:18:57.690075375 (118h21m47.627733874s) [seg_pos={0 0}, upload=113714]: Segment reached optimal threshold of 13 pieces. Aug 4 16:18:57.690245260 (118h21m47.627903749s) [noise=true , address=45.91.116.14:4190 , piece_id=7QBTI3SCRTWBVGE77THDPVEKBE6F36UOXGXPRTJLWLKSHDAV6HEQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Aug 4 16:18:57.690312398 (118h21m47.627970897s) [noise=true , address=45.91.116.11:4118 , piece_id=3DC3BORHVWAGF2PAS2GLEX3NMFMJETBRQQWLNPWLDHFNCCNLXAWA, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37362->45.91.116.11:4118: use of closed network connection Aug 4 16:18:57.690359428 (118h21m47.628017927s) [noise=true , address=45.91.116.10:4082 , piece_id=FRB3EVRTMRTR6VATM7GRKXPO2FXDOQCCPG3DASJRYWZBVMBKNTXQ, seg_pos={0 0}, upload=113714]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46480->45.91.116.10:4082: use of closed network connection Aug 4 16:18:57.690376110 (118h21m47.628034609s) [seg_pos={0 0}, upload=113714]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 4 16:18:57.690439481 (118h21m47.62809798s) [upload=113714]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 4 16:18:57.690442958 (118h21m47.628101457s) [upload=113714]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 4 16:18:58.023198180 (118h21m47.960856679s) [upload=113714]: Done uploading segments... Aug 4 16:18:58.023217707 (118h21m47.960876196s) [upload=113714]: Upload finished. err: <nil> Duration: 5.753089973s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.058600056s FAIL (2025-08-04 16:57:42 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 6.058625294s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.039469339s FAIL (2025-08-04 16:57:41 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.039489959s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)