Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.826599228s FAIL (2025-07-16 06:53:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.82662655s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.784590543s FAIL (2025-07-16 06:53:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.78461997s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.80564816s FAIL (2025-07-16 06:52:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.805678108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.914947001s FAIL (2025-07-16 06:52:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.914976107s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.019103364s FAIL (2025-07-16 06:51:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.019135776s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.047635361s FAIL (2025-07-16 06:50:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.047663504s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.802128685s FAIL (2025-07-16 06:48:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.802155868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.819177228s FAIL (2025-07-16 06:47:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.819202096s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.773361311s FAIL (2025-07-16 06:46:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.773382193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.001592988s FAIL (2025-07-16 06:45:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.001617624s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 12.719710453s FAIL (2025-07-16 06:45:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 12.71974011s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.241706129s FAIL (2025-07-16 06:44:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.241735705s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.955310689s FAIL (2025-07-16 06:16:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.955332431s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.846202869s FAIL (2025-07-16 06:15:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.846225432s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.093942933s FAIL (2025-07-16 06:14:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.093965977s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.202663423s FAIL (2025-07-16 06:14:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.202685365s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 11.422295842s FAIL (2025-07-16 06:13:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.422320318s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.127551003s FAIL (2025-07-16 06:13:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.127573156s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.83470531s FAIL (2025-07-16 06:12:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.834726482s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.264928451s FAIL (2025-07-16 06:12:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.264952577s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.079269718s FAIL (2025-07-16 06:10:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.079298152s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.015446459s FAIL (2025-07-16 06:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.015481245s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.207376334s FAIL (2025-07-16 06:09:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.207392784s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.373911859s FAIL (2025-07-16 06:08:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.373929602s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 7.874283189s FAIL (2025-07-16 06:08:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.874309491s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.243494831s FAIL (2025-07-16 06:07:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.243522232s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.297902104s FAIL (2025-07-16 06:06:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.297924638s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 7.69174437s FAIL (2025-07-16 06:06:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.691765001s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.724637884s FAIL (2025-07-16 06:05:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.724664275s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 7.214251126s FAIL (2025-07-16 06:05:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.214273049s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.223301566s FAIL (2025-07-16 06:04:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.223327095s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 7.433793706s FAIL (2025-07-16 06:03:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.433815969s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 7.40793716s FAIL (2025-07-16 06:03:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.407959392s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.045769067s FAIL (2025-07-16 06:02:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.045793503s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.990761409s FAIL (2025-07-16 06:01:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.990784885s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.244792526s FAIL (2025-07-16 06:00:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.244812764s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 7.046950445s FAIL (2025-07-16 05:59:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.046974811s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.032271895s FAIL (2025-07-16 05:59:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.032292725s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 7.142481694s FAIL (2025-07-16 05:58:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.14250605s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.532251098s FAIL (2025-07-16 05:57:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.532278761s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.285760824s FAIL (2025-07-16 05:56:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.28578476s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X............................X..............................] duration: 6.569735452s FAIL (2025-07-16 05:56:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.569754048s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X............................X.............................] duration: 6.414196615s FAIL (2025-07-16 05:55:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.414218427s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X............................X............................] duration: 6.013242614s FAIL (2025-07-16 05:54:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.013259698s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X............................X...........................] duration: 6.105715625s FAIL (2025-07-16 05:53:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.10573893s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X............................X..........................] duration: 5.981752612s FAIL (2025-07-16 05:53:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.981784683s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X............................X.........................] duration: 6.261936228s FAIL (2025-07-16 05:52:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.26195868s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X............................X........................] duration: 6.077569329s FAIL (2025-07-16 05:51:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.077591271s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X............................X.......................] duration: 6.420923177s FAIL (2025-07-16 05:51:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.420945309s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X............................X......................] duration: 6.652560219s FAIL (2025-07-16 05:50:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.652585246s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)