Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.897023075s FAIL (2025-07-03 22:03:53 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.897051058s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.921691279s FAIL (2025-07-03 22:02:57 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.921721417s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.9058535s FAIL (2025-07-03 22:02:29 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.905877335s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.876646221s FAIL (2025-07-03 22:02:05 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.876674006s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.958421502s FAIL (2025-07-03 22:01:38 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.95845265s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.095930491s FAIL (2025-07-03 22:01:08 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.095952805s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.048898223s FAIL (2025-07-03 22:00:53 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.048919835s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.209183377s FAIL (2025-07-03 22:00:30 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.209207784s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.883832652s FAIL (2025-07-03 21:59:25 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.883856968s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.876222823s FAIL (2025-07-03 21:58:45 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.876253884s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.870303008s FAIL (2025-07-03 21:58:29 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.870322445s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.83658472s FAIL (2025-07-03 21:57:37 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.836606481s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.963934876s FAIL (2025-07-03 21:57:03 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.963964954s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.991188817s FAIL (2025-07-03 21:55:57 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.991214206s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.90347966s FAIL (2025-07-03 21:54:55 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.90350652s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.890039859s FAIL (2025-07-03 21:54:17 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.890069496s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.936693554s FAIL (2025-07-03 21:53:51 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.936718109s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.072405064s FAIL (2025-07-03 21:52:48 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.072432055s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.913999554s FAIL (2025-07-03 21:52:23 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.914027087s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.906294546s FAIL (2025-07-03 21:51:39 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.906321005s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.941191938s FAIL (2025-07-03 21:51:00 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.941215263s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.872365773s FAIL (2025-07-03 21:49:54 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.872399509s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000449604s FAIL (2025-07-03 21:49:30 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 30.000477736s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.767035569s FAIL (2025-07-03 13:03:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.767060005s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.726921401s FAIL (2025-07-03 13:02:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.726949964s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.659319911s FAIL (2025-07-03 13:01:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.65934614s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.662072955s FAIL (2025-07-03 13:01:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.662099725s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.661111378s FAIL (2025-07-03 13:00:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.661141156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.670730891s FAIL (2025-07-03 13:00:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.670761851s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.654997043s FAIL (2025-07-03 12:59:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.655020657s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.759499663s FAIL (2025-07-03 12:58:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.759523939s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.891438106s FAIL (2025-07-03 12:57:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.891467933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.751841213s FAIL (2025-07-03 12:56:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.751942277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.773054967s FAIL (2025-07-03 12:55:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.773148767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.648933623s FAIL (2025-07-03 12:54:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.648962008s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.745331096s FAIL (2025-07-03 12:54:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.745356705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.668823425s FAIL (2025-07-03 12:53:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.66885214s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.639377404s FAIL (2025-07-03 12:52:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.639406589s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 8.610790364s FAIL (2025-07-03 12:52:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 8.610813418s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.028891275s FAIL (2025-07-03 12:51:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.028917094s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.755553914s FAIL (2025-07-03 12:51:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.755584351s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.636431775s FAIL (2025-07-03 12:50:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.636456443s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.666073088s FAIL (2025-07-03 12:50:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.666125558s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.651282781s FAIL (2025-07-03 12:49:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.651311465s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.656893898s FAIL (2025-07-03 12:48:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.656921121s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.706496521s FAIL (2025-07-03 12:48:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.70652741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.66506621s FAIL (2025-07-03 12:47:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.665094005s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.651624333s FAIL (2025-07-03 12:46:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.651649932s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.820152549s FAIL (2025-07-03 12:45:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.820179292s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.713271391s FAIL (2025-07-03 12:44:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 12:20:30.340466822 (243h10m5.111108157s) [upload=194445]: Done uploading segments... Jul 3 12:20:30.340488313 (243h10m5.111129648s) [upload=194445]: Upload finished. err: <nil> Jul 3 12:21:01.408651148 (243h10m36.179292483s) [upload=194453]: Starting upload Jul 3 12:21:01.408712885 (243h10m36.17935422s) [upload=194453]: Done starting upload Jul 3 12:21:01.408844107 (243h10m36.179485442s) [upload=194453]: Uploading segments... Jul 3 12:21:01.408952825 (243h10m36.17959416s) [upload=194453]: Got next segment. Inline: false Jul 3 12:21:01.409001809 (243h10m36.179643144s) [upload=194453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 3 12:21:01.409007830 (243h10m36.179649165s) [upload=194453]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 3 12:21:01.644214556 (243h10m36.414855891s) [seg_pos={0 0}, upload=194453]: Begin upload segment... Jul 3 12:21:01.644275844 (243h10m36.414917179s) [seg_pos={0 0}, upload=194453]: Done begin upload segment. Jul 3 12:21:01.644337802 (243h10m36.414979147s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644386506 (243h10m36.415027841s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644907011 (243h10m36.415548356s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.644973589 (243h10m36.415614924s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645307067 (243h10m36.415948412s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645487481 (243h10m36.416128836s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.645723062 (243h10m36.416364407s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.646132456 (243h10m36.416773791s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647101249 (243h10m36.417742594s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647478560 (243h10m36.418119905s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.647867955 (243h10m36.41850929s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648197536 (243h10m36.418838871s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648581791 (243h10m36.419223126s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.648922433 (243h10m36.419563768s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649263816 (243h10m36.419905151s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:01.649599538 (243h10m36.420240873s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Uploading piece... Jul 3 12:21:03.277210623 (243h10m38.047851948s) [upload=194453]: Next returned nil segment Jul 3 12:21:03.277228466 (243h10m38.047869812s) [upload=194453]: Waiting for error group managing segments... Jul 3 12:21:03.538906484 (243h10m38.309547809s) [noise=true , address=104.36.82.12:4151 , piece_id=DPQWV7C3ZT6ZPQEJURAMMEL3G4WPHHQZ5BEH7TUMIWS2HM3UPRNA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.595541314 (243h10m38.366182649s) [noise=true , address=104.36.82.10:4079 , piece_id=MWE5X5BSHR2V3BRKF45NUHHXVTHRIWNSYPXFXM2EALD22T32D2PQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.599492944 (243h10m38.370134269s) [noise=true , address=104.36.82.6:4875 , piece_id=LKDAWY4GCEOO4Q3WO2ASWB3443IDZ5TAUSDVQ4OWLU7XUOYT2D3A, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.613103161 (243h10m38.383744496s) [noise=true , address=104.36.82.11:4115 , piece_id=ECQAOD7WN7Z5QKSC4U43N3MRVDX5V4N2AVV23DGVPCFXE7ZMJYGA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.642864218 (243h10m38.413505553s) [noise=true , address=104.36.82.15:4257 , piece_id=ELFIRLJUWLKAGFRP5YLKKG2ZN2WVEH7YFT3A5HEQAYZJTYQ3A7CA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.735480123 (243h10m38.506121458s) [noise=true , address=104.36.82.14:4223 , piece_id=4YBLMZXCCDVJYVLFXKLPOMUSNRXCIHOQGVTRQ5AGSOWVISFW7SMA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.756306776 (243h10m38.526948151s) [noise=true , address=104.36.82.9:4006 , piece_id=IYOHU4CL6ILDJFSTDLQRGGNOWSKUFTENWL3GORBQBII4ZLHNBE7Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:03.855913565 (243h10m38.6265549s) [noise=true , address=104.36.82.2:4732 , piece_id=UDJSISRGTNLT4GQ3ARF6T5WVIWWLZUZMYI7HRKCE4356LC73C7IA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:05.910841421 (243h10m40.681482756s) [noise=true , address=104.36.82.5:4840 , piece_id=NIJ4LKGQXTHHXMA6ALFDY6CZM3YPP5NM2FKWAXSD2BY5OOIJCTDQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.150146516 (243h10m40.920787851s) [noise=true , address=45.91.116.11:4119 , piece_id=PI6O3OLWQHU2BGSCOYU67SMD7IKKYXE4L7XI6F7SYIAER4WRCM4Q, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:06.291707347 (243h10m41.062348682s) [noise=true , address=45.91.116.5:4298 , piece_id=HMJIZJ6PFXER7IK6ZRDSACIQZUC6IUYET45BAQVQTNKFCTF44TLQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:13.374083231 (243h10m48.144724566s) [noise=true , address=45.91.116.7:4011 , piece_id=2ZZQFQPPPVJ4OXW2JASGJXTLVYG6MSQLBPKZUEDMQZQUHOFEHDIQ, seg_pos={0 0}, upload=194453]: Done uploading piece. err: <nil> Jul 3 12:21:30.708319515 (243h11m5.47896085s) [noise=true , address=77.90.31.10:4517 , piece_id=O7Y6N7VPKZK5A36NJAUEEZZ3VF7FKRE7I6RSQXU7BKETX574CERA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47600->77.90.31.10:4517: use of closed network connection Jul 3 12:21:30.708379560 (243h11m5.479020895s) [noise=true , address=77.90.31.15:4697 , piece_id=BEIUG2I7GQOEMEXNK7JU3VNFK2FT5ITLDCBEDIN4RKD7B52JCGFA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39210->77.90.31.15:4697: use of closed network connection Jul 3 12:21:30.708614900 (243h11m5.479256235s) [noise=true , address=77.90.31.12:4592 , piece_id=V43L4RUKOSVEBAD2YPARQXGRHY77OE4F5DECHDSMR2TZQZYTANEA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58504->77.90.31.12:4592: use of closed network connection Jul 3 12:21:30.709001149 (243h11m5.479642484s) [noise=true , address=77.90.31.14:4663 , piece_id=EHMWGSCRLVQKN5J6QK5DS5NBELDW7BCDBOSZ564WM2FMDWVT56EA, seg_pos={0 0}, upload=194453]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53534->77.90.31.14:4663: use of closed network connection Jul 3 12:21:30.709030845 (243h11m5.479672181s) [seg_pos={0 0}, upload=194453]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 3 12:21:30.956154170 (243h11m5.726795505s) [upload=194453]: Done uploading segments... Jul 3 12:21:30.956179397 (243h11m5.726820732s) [upload=194453]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.71329678s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)