Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.605276524s FAIL (2025-07-03 09:14:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.605301421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.761849856s FAIL (2025-07-03 09:14:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.761876077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.673977297s FAIL (2025-07-03 09:13:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.674001302s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.840204732s FAIL (2025-07-03 09:12:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.840231162s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.695324407s FAIL (2025-07-03 09:11:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.695351078s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.3964418s FAIL (2025-07-03 09:11:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 6.396471816s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.666160785s FAIL (2025-07-03 09:10:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.666189721s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.827768117s FAIL (2025-07-03 09:09:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.827796432s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.83880022s FAIL (2025-07-03 09:08:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.838839656s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.640108126s FAIL (2025-07-03 09:08:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.640138394s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.687069317s FAIL (2025-07-03 09:07:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.687099173s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.696727212s FAIL (2025-07-03 09:06:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.69675202s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.612103509s FAIL (2025-07-03 09:06:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.612126524s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.710883626s FAIL (2025-07-03 09:05:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.710909293s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.616707296s FAIL (2025-07-03 09:05:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.616733246s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.712209546s FAIL (2025-07-03 09:04:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.712233181s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.947050823s FAIL (2025-07-03 09:03:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.947078016s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.619643544s FAIL (2025-07-03 09:02:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.619671749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.607943641s FAIL (2025-07-03 09:01:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.607997375s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.602728631s FAIL (2025-07-03 09:00:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.602754452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.579925589s FAIL (2025-07-03 09:00:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.579956438s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.741841743s FAIL (2025-07-03 08:59:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.741871088s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.599547919s FAIL (2025-07-03 08:58:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.599571504s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.742931428s FAIL (2025-07-03 08:58:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.742954902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.694226674s FAIL (2025-07-03 08:57:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.694255599s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.777055482s FAIL (2025-07-03 08:56:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.777083707s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.68389893s FAIL (2025-07-03 08:56:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.683920411s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.707033292s FAIL (2025-07-03 08:55:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.707054463s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.71222302s FAIL (2025-07-03 08:54:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.712246344s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.54556487s FAIL (2025-07-03 08:53:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.545596211s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.554235731s FAIL (2025-07-03 08:53:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.554267201s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.840996328s FAIL (2025-07-03 08:53:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.841022628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.590943459s FAIL (2025-07-03 08:51:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.590962496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.59317553s FAIL (2025-07-03 08:51:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.593210146s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.643371326s FAIL (2025-07-03 08:50:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.643395652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.591671133s FAIL (2025-07-03 08:50:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.591705147s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.656858751s FAIL (2025-07-03 08:49:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.656887977s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.665274271s FAIL (2025-07-03 08:48:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.665303337s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.697277898s FAIL (2025-07-03 08:47:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.697301423s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.736190871s FAIL (2025-07-03 08:46:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.736218552s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.82871616s FAIL (2025-07-03 08:46:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.828740688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.615891359s FAIL (2025-07-03 08:45:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.615920394s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.756612874s FAIL (2025-07-03 08:45:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.756640908s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.719265094s FAIL (2025-07-03 08:44:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.719289591s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.729479414s FAIL (2025-07-03 08:44:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.729508099s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.660466503s FAIL (2025-07-03 08:43:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 5.660494577s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.241330062s FAIL (2025-07-03 08:42:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== eg_pos={0 0}, upload=191557]: Done begin upload segment. Jul 3 08:42:15.207606115 (239h31m49.97824745s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207617276 (239h31m49.978258611s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.207939112 (239h31m49.978580437s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208127453 (239h31m49.978768788s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208408060 (239h31m49.979049395s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208733232 (239h31m49.979374567s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.208762568 (239h31m49.979403903s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209000163 (239h31m49.979641498s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209190928 (239h31m49.979832263s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209225824 (239h31m49.979867159s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209458689 (239h31m49.980100025s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209620710 (239h31m49.980262045s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209709409 (239h31m49.980350744s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.209930712 (239h31m49.980572047s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210133471 (239h31m49.980774796s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:15.210514820 (239h31m49.981156155s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Uploading piece... Jul 3 08:42:16.882521289 (239h31m51.653162624s) [upload=191557]: Next returned nil segment Jul 3 08:42:16.882541407 (239h31m51.653182742s) [upload=191557]: Waiting for error group managing segments... Jul 3 08:42:17.149026216 (239h31m51.919667541s) [noise=true , address=104.36.82.9:4005 , piece_id=KSFAUN6CIZYZZFTEX7T6YP43GH2K3ZILBZIYCYOEIJ5ILG6EQHJA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.190174868 (239h31m51.960816203s) [noise=true , address=104.36.82.15:4257 , piece_id=2HUFWH2NSHUB3MHQ52PO3NCGWIVJ4CIJJD24DBTXMLB67BSZ3SOQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.248711316 (239h31m52.019352651s) [noise=true , address=104.36.82.7:4910 , piece_id=OXXAAXERXA7HTYIMCTPB3GD3FFUCQBOUI7RVOCHXJ2UMKDILIGJQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:17.278374525 (239h31m52.04901586s) [noise=true , address=104.36.82.5:4838 , piece_id=T3RDNEMK5FR33WRBRLDO2UT34SLOUFBKLW652TB6QC3CHNKXJDPA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:18.807962921 (239h31m53.578604256s) [noise=true , address=45.91.116.11:4117 , piece_id=5LVVNVUU2TIE7CNXTTW7DTTSEW357KESUJZV6KI7ME2FGYFGSYVQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:19.321679918 (239h31m54.092321253s) [noise=true , address=45.91.116.9:4263 , piece_id=V5NDZMYAFF3EJEOEHVOGSOHE5O566MQ7MVMQRHS2UGPHU2DEDFKA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.063591957 (239h31m54.834233292s) [noise=true , address=45.91.116.8:4048 , piece_id=QMWQ7RAR6WEQKF22D36JGA42X77Z77JXY45OK3W62O23NGBEOCTQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:20.123633384 (239h31m54.89427478s) [noise=true , address=45.91.116.12:4227 , piece_id=RMA77AGKLIGQRKA75UWNJZVJRG4PM3YAQ2TD2HHF3DJNYHDWZJLA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:23.485425564 (239h31m58.256066899s) [noise=true , address=45.91.116.4:4937 , piece_id=XPTX4FSUYKVYZFARBCNOJ7ZQUSAM6DYMEXAW7KAJEWRIJX36NIFQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: <nil> Jul 3 08:42:44.322062124 (239h32m19.092703459s) [noise=true , address=77.90.31.18:4805 , piece_id=DT6EIRTBDBPYYCBKALBDGPP75WMMU24WGCT25MSW5V7SDY2PQJAQ, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44746->77.90.31.18:4805: use of closed network connection Jul 3 08:42:44.322162176 (239h32m19.092803511s) [noise=true , address=77.90.31.17:4771 , piece_id=OEZ3QX7CRFXL73EXECTKAGUC2PX3VUHKS3GCWFKU3IOIOLGPECQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58328->77.90.31.17:4771: use of closed network connection Jul 3 08:42:44.322230095 (239h32m19.092871431s) [noise=true , address=77.90.31.21:4879 , piece_id=MGCCS4G7PDI25GDF6BG3WDMQUKQH4D6YXBLFHDO4SA53VMATFB5Q, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57688->77.90.31.21:4879: use of closed network connection Jul 3 08:42:44.322270814 (239h32m19.092912149s) [noise=true , address=77.90.31.13:4626 , piece_id=RZWLWSJSGH73FXB5ANNCZZGS3KOWE3AI376KUZGKFU4QYVRC27MA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45144->77.90.31.13:4626: use of closed network connection Jul 3 08:42:44.322307303 (239h32m19.092948638s) [noise=true , address=77.90.31.10:4518 , piece_id=ZVPNJ7CE6RFAVCXJGW6PBB3DBMFA7ZHLRYYSPON4JASHWYL44GIA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34754->77.90.31.10:4518: use of closed network connection Jul 3 08:42:44.322362769 (239h32m19.093004105s) [noise=true , address=77.90.31.14:4662 , piece_id=BPVTIZXTAH36DTFA2MHNLKGQ7CRZUF2WAOV73AV7LMJEO6C2JHQA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 188.166.225.170:40830->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322447972 (239h32m19.093089338s) [noise=true , address=77.90.31.19:4841 , piece_id=G2VXPN4FGNTXPZ522YAUGG7FKZFKSTHTZ4CNN2FYHDDHILITLBYA, seg_pos={0 0}, upload=191557]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 188.166.225.170:50222->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 3 08:42:44.322490354 (239h32m19.093131689s) [seg_pos={0 0}, upload=191557]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Jul 3 08:42:44.562459395 (239h32m19.33310073s) [upload=191557]: Done uploading segments... Jul 3 08:42:44.562485345 (239h32m19.33312668s) [upload=191557]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.241353357s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 993.648266ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-03 08:14:27 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 993.676229ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 728.608561ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-03 08:13:37 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 728.637657ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 749.7202ms target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-07-03 08:12:45 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout Duration: 749.744556ms edge gateway vhost us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)