Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.106864391s FAIL (2025-08-25 00:55:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.106886654s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.X........................................................] duration: 4.962610745s FAIL (2025-08-25 00:55:17 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.962636164s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.357626059s FAIL (2025-08-25 00:55:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 6.357654564s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X..................X....X..X......X......X..........] duration: 1.837983287s FAIL (2025-08-25 00:54:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.838008677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration: 4.957020211s FAIL (2025-08-25 00:54:14 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.957040739s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.86960684s FAIL (2025-08-25 00:54:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.869634062s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.801656242s FAIL (2025-08-25 00:54:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.801682843s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.902341967s FAIL (2025-08-25 00:53:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.902363158s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.X......................................................] duration: 4.850472395s FAIL (2025-08-25 00:53:49 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.850499828s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X..................X....X..X......X......X.........] duration: 2.017806661s FAIL (2025-08-25 00:53:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 2.017833261s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.094252462s FAIL (2025-08-25 00:53:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.094271368s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.650738402s FAIL (2025-08-25 00:53:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.650764002s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X..................X....X..X......X......X........] duration: 1.848658666s FAIL (2025-08-25 00:53:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.848681951s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.603096832s FAIL (2025-08-25 00:52:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.603123102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration: 4.902356432s FAIL (2025-08-25 00:52:58 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.902384476s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...........X..................X....X..X......X......X.......] duration: 1.898076461s FAIL (2025-08-25 00:52:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.898093744s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.887693964s FAIL (2025-08-25 00:52:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.887713591s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [............X..................X....X..X......X......X......] duration: 1.91912648s FAIL (2025-08-25 00:52:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.919150796s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.804289793s FAIL (2025-08-25 00:52:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.804314899s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.X....................................................] duration: 4.926800021s FAIL (2025-08-25 00:51:45 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.926825089s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.X...................................................] duration: 4.909351614s FAIL (2025-08-25 00:51:25 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.909381582s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.063711236s FAIL (2025-08-25 00:51:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.063793564s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.............X..................X....X..X......X......X.....] duration: 1.820033714s FAIL (2025-08-25 00:51:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.820061789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.969390632s FAIL (2025-08-25 00:50:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.969443283s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.X..................................................] duration: 4.777989625s FAIL (2025-08-25 00:50:54 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.778008941s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.819670208s FAIL (2025-08-25 00:50:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.819695066s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.20891302s FAIL (2025-08-25 00:50:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.20893367s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..............X..................X....X..X......X......X....] duration: 1.951620038s FAIL (2025-08-25 00:50:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.951645406s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.822638045s FAIL (2025-08-25 00:50:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.822672953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.X.................................................] duration: 4.958256775s FAIL (2025-08-25 00:49:40 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.958281955s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.937297235s FAIL (2025-08-25 00:49:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.937320641s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.743880651s FAIL (2025-08-25 00:49:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.743902232s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.909185571s FAIL (2025-08-25 00:49:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.909203034s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...............X..................X....X..X......X......X...] duration: 1.844384291s FAIL (2025-08-25 00:48:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.844417586s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.X................................................] duration: 5.271285247s FAIL (2025-08-25 00:48:52 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.271321577s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [................X..................X....X..X......X......X..] duration: 2.002033062s FAIL (2025-08-25 00:48:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 2.002062299s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.931171685s FAIL (2025-08-25 00:48:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.931193306s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.X...............................................] duration: 5.122733725s FAIL (2025-08-25 00:48:02 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.122761959s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.14098796s FAIL (2025-08-25 00:47:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.141004861s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [X................X..................X....X..X......X......X.] duration: 1.909141167s FAIL (2025-08-25 00:47:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.909178238s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.309455892s FAIL (2025-08-25 00:47:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.30947589s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.860167164s FAIL (2025-08-25 00:47:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.860200999s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X.X..............................................] duration: 4.85823828s FAIL (2025-08-25 00:47:16 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.858267626s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X.X.............................................] duration: 4.857293001s FAIL (2025-08-25 00:46:52 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.85731847s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.996775713s FAIL (2025-08-25 00:46:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.996796983s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.642511521s FAIL (2025-08-25 00:46:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 25 00:31:48.863038688 (391h5m43.294118819s) [upload=406855]: Starting upload Aug 25 00:31:48.863115494 (391h5m43.294195626s) [upload=406855]: Done starting upload Aug 25 00:31:48.863195307 (391h5m43.294275438s) [upload=406855]: Uploading segments... Aug 25 00:31:48.863315368 (391h5m43.294395489s) [upload=406855]: Got next segment. Inline: false Aug 25 00:31:48.863342258 (391h5m43.294422389s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:31:48.863346567 (391h5m43.294426698s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 25 00:31:49.312286325 (391h5m43.743366496s) [seg_pos={0 0}, upload=406855]: Begin upload segment... Aug 25 00:31:49.312353935 (391h5m43.743434076s) [seg_pos={0 0}, upload=406855]: Done begin upload segment. Aug 25 00:31:49.312395584 (391h5m43.743475735s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.312423417 (391h5m43.743503558s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313318059 (391h5m43.74439821s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.313431927 (391h5m43.744512068s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314038226 (391h5m43.745118367s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.314582197 (391h5m43.745662328s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315126318 (391h5m43.746206459s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315138030 (391h5m43.746218161s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315540499 (391h5m43.746620631s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315618659 (391h5m43.74669879s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.315927209 (391h5m43.74700735s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316097254 (391h5m43.747177386s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316527047 (391h5m43.747607188s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316672024 (391h5m43.747752165s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.316959784 (391h5m43.748039915s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317377864 (391h5m43.748457995s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.317873382 (391h5m43.748953513s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:49.320133225 (391h5m43.751213356s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Uploading piece... Aug 25 00:31:50.810358828 (391h5m45.241438969s) [upload=406855]: Next returned nil segment Aug 25 00:31:50.810394196 (391h5m45.241474328s) [upload=406855]: Waiting for error group managing segments... Aug 25 00:31:51.210440519 (391h5m45.64152065s) [noise=true , address=77.90.31.15:4702 , piece_id=RXRATVGCTE6A3KEB423RRQACXOS3RDFK6DE6YNVO23GNMTQIOUIA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.213394580 (391h5m45.644474711s) [noise=true , address=79.127.219.47:4049 , piece_id=ET37LJ4FGF6XPLZREOSZU3HOMABPMJUGZGDJRBMOUKEJ7UWKJNUA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.231493410 (391h5m45.662573541s) [noise=true , address=104.36.82.61:4401 , piece_id=EYPDQ6OG2HQDIIE7FHNVD2LBA54DEYNQ5W764CWKV23VFFYP36ZA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.243222506 (391h5m45.674302637s) [noise=true , address=104.36.82.12:4167 , piece_id=RS2WHSU3JA7WKQQ34OQDZALGKTIDZFJ2JYRBB5DT5PM7YUGIAN3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.249613922 (391h5m45.680694053s) [noise=true , address=104.36.82.12:4157 , piece_id=WRBFMQPK63NXYMANYKCHBESOJ4HE24XRFW2DOO64ROVJ4Y2HCMVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.266401053 (391h5m45.697481184s) [noise=true , address=104.36.82.42:4802 , piece_id=JZX7WOEYHLBV3ILXH2FUYDPJDVP4BB5J2FSUHBZV4UUOD3UAIT2Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.267655353 (391h5m45.698735474s) [noise=true , address=104.36.82.41:4788 , piece_id=A23ABRHBB52CEKEKC4QHP2JISMEC4CHNJT6P7AMQJBZMHITV74KQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.290375504 (391h5m45.721455645s) [noise=true , address=77.90.31.12:4606 , piece_id=YR5UNTABKKP4FKEKFRJWTPIMS3I3JUOKWMRWNPCG7BRVB2XPMSRA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.293400571 (391h5m45.724480702s) [noise=true , address=104.36.82.35:4582 , piece_id=DK4MCY3IXOZVKYKVIARRJL5QAC63B5CBPRVZWUV6ULYFX22PKBCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.307130313 (391h5m45.738210444s) [noise=true , address=104.36.82.20:4438 , piece_id=E27Z3JXPVWYAOOC3OLT5EHTW3IVMOFXB356KPS2Z5WTAUIA6TLCQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.313678539 (391h5m45.74475867s) [noise=true , address=104.36.82.22:4525 , piece_id=44YI7XZTOWBM6THLKSU7Z4TECBYC6OIAEATJCGRQLYJQJNFPCV7A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.315638147 (391h5m45.746718278s) [noise=true , address=104.36.82.36:4630 , piece_id=KIDXJYM4AB2KMQPFTJW62KRHGIOMZLUX66K33H6JKWI2N2GROZNQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.321706365 (391h5m45.752786496s) [noise=true , address=104.36.82.9:4022 , piece_id=33NCZGSRO4AHLCQ3ZKOBLXNLP25DLV47MUCWGEJLS27FY6DH2DWA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335394859 (391h5m45.76647499s) [noise=true , address=104.36.82.60:4366 , piece_id=CLUULFYSH6PXFEXHIKBWDA5EUYUFK4FDXBWPXHMM7RMHNLAYDO4A, seg_pos={0 0}, upload=406855]: Done uploading piece. err: <nil> Aug 25 00:31:51.335414066 (391h5m45.766494197s) [seg_pos={0 0}, upload=406855]: Segment reached optimal threshold of 14 pieces. Aug 25 00:31:51.335555436 (391h5m45.766635568s) [noise=true , address=104.36.82.11:4131 , piece_id=EDYHUPUXVEFMKBQ4PGNEJ4ZF2ADACGXP623OUL5XQVAXHNV7EMOQ, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129jahwAmyPHqyYaXz7XTCK8FakBrYZw94pBKGhPzzX23yjM3RQ): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335661630 (391h5m45.766741761s) [noise=true , address=104.36.82.19:4406 , piece_id=TX6HYQRJJGGV32TATLAPLOPCGLJVBI4ZSRQODH22WQCRGJUU3R3Q, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335668823 (391h5m45.766748944s) [noise=true , address=45.91.116.4:4941 , piece_id=4TL2YETVM6X6MB7D55QIJBFQCEGEW2BKZDAYUHK5COIBZEQBYJVA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N1YuMnuTFjGboQrrfxXEbJm4HwhADdNn8F5c7wWwQYpjgFZoY): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335747514 (391h5m45.766827645s) [noise=true , address=104.36.82.10:4096 , piece_id=GG5H73EZAQYPOAIKTJ5EKUJBGEVBIZVJSFKHSNYYTPSZFWNCXICA, seg_pos={0 0}, upload=406855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1U9C1EMFMyt1sdCP5pEhckjj7fW75S7vUbswchN1Rp4s3b6RkA): protocol: expected piece hash; context canceled; EOF Aug 25 00:31:51.335766030 (391h5m45.766846161s) [seg_pos={0 0}, upload=406855]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 25 00:31:51.335835342 (391h5m45.766915473s) [upload=406855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 25 00:31:51.335839219 (391h5m45.76691934s) [upload=406855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:31:51.664762415 (391h5m46.095842586s) [upload=406855]: Done uploading segments... Aug 25 00:31:51.664786741 (391h5m46.095866912s) [upload=406855]: Upload finished. err: <nil> Duration: 5.642536038s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.X................X..................X....X..X......X......X] duration: 1.623409644s FAIL (2025-08-25 00:46:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 25 00:46:30.467591785 (391h20m24.898671916s) [upload=407105]: Starting upload Aug 25 00:46:30.467672199 (391h20m24.89875235s) [upload=407105]: Done starting upload Aug 25 00:46:30.467747452 (391h20m24.898827603s) [upload=407105]: Uploading segments... Aug 25 00:46:30.467801014 (391h20m24.898881176s) [upload=407105]: Got next segment. Inline: true Aug 25 00:46:30.467808148 (391h20m24.898888299s) [upload=407105]: Waiting for error group managing segments... Aug 25 00:46:30.467858665 (391h20m24.898938796s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:46:30.467865969 (391h20m24.898946131s) [upload=407105]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:46:30.467870889 (391h20m24.89895105s) [upload=407105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:46:31.001184207 (391h20m25.432264348s) [upload=407105]: Done uploading segments... Aug 25 00:46:31.001204275 (391h20m25.432284416s) [upload=407105]: Upload finished. err: <nil> Duration:* 1.623437989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.976813611s FAIL (2025-08-25 00:46:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.976846895s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.X............................................] duration: 4.909490763s FAIL (2025-08-25 00:46:13 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.909518225s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X................X..................X....X..X......X......] duration: 1.941406567s FAIL (2025-08-25 00:45:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 00:41:14.260650553 (391h15m8.691730684s) [upload=407017]: Starting upload Aug 25 00:41:14.260699307 (391h15m8.691779438s) [upload=407017]: Done starting upload Aug 25 00:41:14.260748792 (391h15m8.691828923s) [upload=407017]: Uploading segments... Aug 25 00:41:14.260785922 (391h15m8.691866053s) [upload=407017]: Got next segment. Inline: true Aug 25 00:41:14.260789689 (391h15m8.69186982s) [upload=407017]: Waiting for error group managing segments... Aug 25 00:41:14.260823574 (391h15m8.691903705s) [upload=407017]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 25 00:41:14.260827552 (391h15m8.691907673s) [upload=407017]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 25 00:41:14.260830247 (391h15m8.691910378s) [upload=407017]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 25 00:41:14.474749853 (391h15m8.905829984s) [upload=407017]: Done uploading segments... Aug 25 00:41:14.474766865 (391h15m8.905846996s) [upload=407017]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.941435332s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)